Discussion:
[gdal-dev] "OGR_SQLITE_SYNCHRONOUS" and "OGR_SQLITE_CACHE" accessible through Python bindings?
Met Bas
2021-05-23 01:46:09 UTC
Permalink
Write speeds to GeoPackages appear to be going extremely slow in my use case.
GPKG/SQLite journal files are being created at the sizes of 10-25 kb
incrementally increasing the main geopackage file. This is saving on a drive
where such small incremental cause larger slowdowns, so I would like to
increase the size of these changes.

The configuration options "OGR_SQLITE_SYNCHRONOUS" and "OGR_SQLITE_CACHE"
appear relevant to increasing speed.

Is there a way in which I can set these options (limited to the scope of the
script being run) through Python?

Thank you,
M.B



--
Sent from: http://osgeo-org.1560.x6.nabble.com/GDAL-Dev-f3742093.html
jratike80
2021-05-23 07:53:10 UTC
Permalink
Hi,

By reading https://sqlite.org/asyncvfs.html you could try if setting the
journal mode into WAL with a PRAGMA command would help.

-Jukka Rahkonen-
Post by Met Bas
Write speeds to GeoPackages appear to be going extremely slow in my use case.
GPKG/SQLite journal files are being created at the sizes of 10-25 kb
incrementally increasing the main geopackage file. This is saving on a drive
where such small incremental cause larger slowdowns, so I would like to
increase the size of these changes.
The configuration options "OGR_SQLITE_SYNCHRONOUS" and "OGR_SQLITE_CACHE"
appear relevant to increasing speed.
Is there a way in which I can set these options (limited to the scope of the
script being run) through Python?
Thank you,
M.B
--
Sent from: http://osgeo-org.1560.x6.nabble.com/GDAL-Dev-f3742093.html
_______________________________________________
gdal-dev mailing list
https://lists.osgeo.org/mailman/listinfo/gdal-dev
--
Sent from: http://osgeo-org.1560.x6.nabble.com/GDAL-Dev-f3742093.html
Even Rouault
2021-05-23 09:15:21 UTC
Permalink
gdal.SetConfigOption(name_of_config_option, value_as_string)
Post by Met Bas
Write speeds to GeoPackages appear to be going extremely slow in my use case.
GPKG/SQLite journal files are being created at the sizes of 10-25 kb
incrementally increasing the main geopackage file. This is saving on a drive
where such small incremental cause larger slowdowns, so I would like to
increase the size of these changes.
The configuration options "OGR_SQLITE_SYNCHRONOUS" and "OGR_SQLITE_CACHE"
appear relevant to increasing speed.
Is there a way in which I can set these options (limited to the scope of the
script being run) through Python?
Thank you,
M.B
--
Sent from: http://osgeo-org.1560.x6.nabble.com/GDAL-Dev-f3742093.html
_______________________________________________
gdal-dev mailing list
https://lists.osgeo.org/mailman/listinfo/gdal-dev
--
http://www.spatialys.com
My software is free, but my time generally not.
Met Bas
2021-05-25 23:25:25 UTC
Permalink
Thank you Jukka and Even. Was able to resolve my issue with the help of your
responses.



--
Sent from: http://osgeo-org.1560.x6.nabble.com/GDAL-Dev-f3742093.html
Loading...