Javier Jimenez Shaw
2021-06-02 14:26:52 UTC
Hello
I am trying to build GDAL (this worked) and run the tests (tons of
failures). Because it is over a clean clone of master, I think there is
something wrong in my configuration. Maybe you can help me.
OS: Ubuntu 20.04
Python: 3.8.5
$ apt list --installed | grep gdal
gdal-bin/focal,now 3.0.4+dfsg-1build3 amd64 [installed]
gdal-data/focal,focal,now 3.0.4+dfsg-1build3 all [installed,automatic]
libgdal-dev/focal,now 3.0.4+dfsg-1build3 amd64 [installed]
libgdal26/focal,now 3.0.4+dfsg-1build3 amd64 [installed,automatic]
python3-gdal/focal,now 3.0.4+dfsg-1build3 amd64 [installed,automatic]
Following the instructions in
https://github.com/OSGeo/gdal/blob/master/CONTRIBUTING.md
cd gdal
./configure
make -j8 -s
cd apps; make -s test_ogrsf; cd ..
. scripts/setdevenv.sh
gdalinfo --version
$ GDAL 3.4.0dev-6b8835c2b5, released 2021/06/02
cd ../autotest
pip install -r requirements.txt
python -m pytest
Test session starts (platform: linux, Python 3.8.5, pytest 4.6.9,
pytest-sugar 0.9.4)
rootdir: /home/jshaw/work/gdal/autotest, inifile: pytest.ini, testpaths:
ogr, gcore, gdrivers, osr, alg, gnm, utilities, pyscripts
plugins: sugar-0.9.4, env-0.6.2
collecting ...
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting gcore/multidim.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
gcore/multidim.py:106: in <module>
???
E AttributeError: module 'osgeo.gdal' has no attribute 'GRIORA_RMS'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting alg/fillnodata.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
/usr/lib/python3/dist-packages/pluggy/hooks.py:286: in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
/usr/lib/python3/dist-packages/pluggy/manager.py:92: in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
/usr/lib/python3/dist-packages/pluggy/manager.py:83: in <lambda>
self._inner_hookexec = lambda hook, methods, kwargs: hook.multicall(
/usr/lib/python3/dist-packages/_pytest/python.py:234: in
pytest_pycollect_makeitem
res = list(collector._genfunctions(name, obj))
/usr/lib/python3/dist-packages/_pytest/python.py:410: in _genfunctions
self.ihook.pytest_generate_tests(metafunc=metafunc)
/usr/lib/python3/dist-packages/pluggy/hooks.py:286: in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
/usr/lib/python3/dist-packages/pluggy/manager.py:92: in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
/usr/lib/python3/dist-packages/pluggy/manager.py:83: in <lambda>
self._inner_hookexec = lambda hook, methods, kwargs: hook.multicall(
/usr/lib/python3/dist-packages/_pytest/python.py:137: in
pytest_generate_tests
metafunc.parametrize(*marker.args, **marker.kwargs)
/usr/lib/python3/dist-packages/_pytest/python.py:1015: in parametrize
ids = self._resolve_arg_ids(argnames, ids, parameters,
item=self.definition)
/usr/lib/python3/dist-packages/_pytest/python.py:1069: in _resolve_arg_ids
ids = idmaker(argnames, parameters, idfn, ids, self.config, item=item)
/usr/lib/python3/dist-packages/_pytest/python.py:1221: in idmaker
ids = [
/usr/lib/python3/dist-packages/_pytest/python.py:1222: in <listcomp>
_idvalset(valindex, parameterset, argnames, idfn, ids, config=config,
item=item)
/usr/lib/python3/dist-packages/_pytest/python.py:1210: in _idvalset
if ids is None or (idx >= len(ids) or ids[idx] is None):
E TypeError: 'dict_keys' object is not subscriptable
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/test_gdal_utils.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/test_gdal_utils.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/test_gdal_utils.py:37: in <module>
from osgeo_utils.auxiliary.extent_util import Extent
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/test_pct.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/test_pct.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/test_pct.py:37: in <module>
from osgeo_utils import gdalattachpct, rgb2pct
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR
collecting pyscripts/gdal2tiles/test_add_alpha_band_to_string_vrt.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_add_alpha_band_to_string_vrt.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_add_alpha_band_to_string_vrt.py:36: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR
collecting pyscripts/gdal2tiles/test_add_gdal_warp_options_to_string.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_add_gdal_warp_options_to_string.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_add_gdal_warp_options_to_string.py:36: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/gdal2tiles/test_nb_data_bands.py
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_nb_data_bands.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_nb_data_bands.py:35: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/gdal2tiles/test_option_parser.py
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_option_parser.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_option_parser.py:37: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR
collecting pyscripts/gdal2tiles/test_reproject_dataset.py
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_reproject_dataset.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_reproject_dataset.py:36: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/gdal2tiles/test_setup_input_srs.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_setup_input_srs.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_setup_input_srs.py:34: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR
collecting pyscripts/gdal2tiles/test_setup_no_data_value.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_setup_no_data_value.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_setup_no_data_value.py:34: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR collecting
pyscripts/gdal2tiles/test_update_alpha_value_for_non_alpha_inputs.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_update_alpha_value_for_non_alpha_inputs.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_update_alpha_value_for_non_alpha_inputs.py:34: in
<module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Interrupted: 12 errors during collection
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Results (5.85s):
If I run a particular file, I get also a many errors (ommited here), and a
core dump:
python -m pytest gcore/tiff_read.py
....
gcore/tiff_read.py ⚯âs 97% ââââââââââ
Segmentation fault (core dumped)
Is there anything basically wrong? Am I using the wrong gdal, not the one
just compiled?
Thanks
.___ ._ ..._ .. . ._. .___ .. __ . _. . __.. ... .... ._ .__
Entre dos pensamientos racionales
hay infinitos pensamientos irracionales.
I am trying to build GDAL (this worked) and run the tests (tons of
failures). Because it is over a clean clone of master, I think there is
something wrong in my configuration. Maybe you can help me.
OS: Ubuntu 20.04
Python: 3.8.5
$ apt list --installed | grep gdal
gdal-bin/focal,now 3.0.4+dfsg-1build3 amd64 [installed]
gdal-data/focal,focal,now 3.0.4+dfsg-1build3 all [installed,automatic]
libgdal-dev/focal,now 3.0.4+dfsg-1build3 amd64 [installed]
libgdal26/focal,now 3.0.4+dfsg-1build3 amd64 [installed,automatic]
python3-gdal/focal,now 3.0.4+dfsg-1build3 amd64 [installed,automatic]
Following the instructions in
https://github.com/OSGeo/gdal/blob/master/CONTRIBUTING.md
cd gdal
./configure
make -j8 -s
cd apps; make -s test_ogrsf; cd ..
. scripts/setdevenv.sh
gdalinfo --version
$ GDAL 3.4.0dev-6b8835c2b5, released 2021/06/02
cd ../autotest
pip install -r requirements.txt
python -m pytest
Test session starts (platform: linux, Python 3.8.5, pytest 4.6.9,
pytest-sugar 0.9.4)
rootdir: /home/jshaw/work/gdal/autotest, inifile: pytest.ini, testpaths:
ogr, gcore, gdrivers, osr, alg, gnm, utilities, pyscripts
plugins: sugar-0.9.4, env-0.6.2
collecting ...
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting gcore/multidim.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
gcore/multidim.py:106: in <module>
???
E AttributeError: module 'osgeo.gdal' has no attribute 'GRIORA_RMS'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting alg/fillnodata.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
/usr/lib/python3/dist-packages/pluggy/hooks.py:286: in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
/usr/lib/python3/dist-packages/pluggy/manager.py:92: in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
/usr/lib/python3/dist-packages/pluggy/manager.py:83: in <lambda>
self._inner_hookexec = lambda hook, methods, kwargs: hook.multicall(
/usr/lib/python3/dist-packages/_pytest/python.py:234: in
pytest_pycollect_makeitem
res = list(collector._genfunctions(name, obj))
/usr/lib/python3/dist-packages/_pytest/python.py:410: in _genfunctions
self.ihook.pytest_generate_tests(metafunc=metafunc)
/usr/lib/python3/dist-packages/pluggy/hooks.py:286: in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
/usr/lib/python3/dist-packages/pluggy/manager.py:92: in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
/usr/lib/python3/dist-packages/pluggy/manager.py:83: in <lambda>
self._inner_hookexec = lambda hook, methods, kwargs: hook.multicall(
/usr/lib/python3/dist-packages/_pytest/python.py:137: in
pytest_generate_tests
metafunc.parametrize(*marker.args, **marker.kwargs)
/usr/lib/python3/dist-packages/_pytest/python.py:1015: in parametrize
ids = self._resolve_arg_ids(argnames, ids, parameters,
item=self.definition)
/usr/lib/python3/dist-packages/_pytest/python.py:1069: in _resolve_arg_ids
ids = idmaker(argnames, parameters, idfn, ids, self.config, item=item)
/usr/lib/python3/dist-packages/_pytest/python.py:1221: in idmaker
ids = [
/usr/lib/python3/dist-packages/_pytest/python.py:1222: in <listcomp>
_idvalset(valindex, parameterset, argnames, idfn, ids, config=config,
item=item)
/usr/lib/python3/dist-packages/_pytest/python.py:1210: in _idvalset
if ids is None or (idx >= len(ids) or ids[idx] is None):
E TypeError: 'dict_keys' object is not subscriptable
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/test_gdal_utils.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/test_gdal_utils.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/test_gdal_utils.py:37: in <module>
from osgeo_utils.auxiliary.extent_util import Extent
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/test_pct.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/test_pct.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/test_pct.py:37: in <module>
from osgeo_utils import gdalattachpct, rgb2pct
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR
collecting pyscripts/gdal2tiles/test_add_alpha_band_to_string_vrt.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_add_alpha_band_to_string_vrt.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_add_alpha_band_to_string_vrt.py:36: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR
collecting pyscripts/gdal2tiles/test_add_gdal_warp_options_to_string.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_add_gdal_warp_options_to_string.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_add_gdal_warp_options_to_string.py:36: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/gdal2tiles/test_nb_data_bands.py
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_nb_data_bands.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_nb_data_bands.py:35: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/gdal2tiles/test_option_parser.py
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_option_parser.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_option_parser.py:37: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR
collecting pyscripts/gdal2tiles/test_reproject_dataset.py
âââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_reproject_dataset.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_reproject_dataset.py:36: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ERROR collecting pyscripts/gdal2tiles/test_setup_input_srs.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_setup_input_srs.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_setup_input_srs.py:34: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR
collecting pyscripts/gdal2tiles/test_setup_no_data_value.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_setup_no_data_value.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_setup_no_data_value.py:34: in <module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ ERROR collecting
pyscripts/gdal2tiles/test_update_alpha_value_for_non_alpha_inputs.py
ââââââââââââââââââââââââââââââââââââââââââââââââââââââââââ
ImportError while importing test module
'/home/jshaw/work/gdal/autotest/pyscripts/gdal2tiles/test_update_alpha_value_for_non_alpha_inputs.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
pyscripts/gdal2tiles/test_update_alpha_value_for_non_alpha_inputs.py:34: in
<module>
from osgeo_utils import gdal2tiles
E ModuleNotFoundError: No module named 'osgeo_utils'
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Interrupted: 12 errors during collection
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Results (5.85s):
If I run a particular file, I get also a many errors (ommited here), and a
core dump:
python -m pytest gcore/tiff_read.py
....
gcore/tiff_read.py ⚯âs 97% ââââââââââ
Segmentation fault (core dumped)
Is there anything basically wrong? Am I using the wrong gdal, not the one
just compiled?
Thanks
.___ ._ ..._ .. . ._. .___ .. __ . _. . __.. ... .... ._ .__
Entre dos pensamientos racionales
hay infinitos pensamientos irracionales.