PYPY3 -- Unable to install Pandas

PYPY3 -- Unable to install Pandas - pandas

I have been trying to install pandas in PYPY with out any success. Below is the complete log message.
Windows 10 64 Bit OS.
Have installed the Visual C++ 2015-2019 redistributable.
Python 3.7 , pip 19.3.1 ( installed through Anaconda)
pypy3.6-v7.2.0-win32
how to resolve this error?
Collecting pandas
Using cached
https://files.pythonhosted.org/packages/b7/93/b544dd08092b457d88e10fc1e0989d9397fd32ca936fdfcbb2584178dd2b/pandas-0.25.3.tar.gz
Complete output from command python setup.py egg_info:
Could not locate executable g77
Could not locate executable f77
Could not locate executable ifort
Could not locate executable ifl
Could not locate executable f90
Could not locate executable DF
Could not locate executable efl
Could not locate executable gfortran
Could not locate executable f95
Could not locate executable g95
Could not locate executable efort
Could not locate executable efc
Could not locate executable flang
don't know how to compile Fortran code on platform 'nt'
'svnversion' is not recognized as an internal or external command,
operable program or batch file.
non-existing path in 'numpy\\distutils': 'site.cfg'
Running from numpy source directory.
C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\setup.py:419: UserWarning: Unrecognized setuptools command, proceeding with generating Cython sources and expanding templates
run_build = parse_setuppy_commands()
C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\system_info.py:690: UserWarning:
Optimized (vendor) Blas libraries are not found.
Falls back to netlib Blas library which has worse performance.
A better performance should be easily gained by switching
Blas library.
self.calc_info()
C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\system_info.py:690: UserWarning:
Blas (http://www.netlib.org/blas/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [blas]) or by setting
the BLAS environment variable.
self.calc_info()
C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\system_info.py:690: UserWarning:
Blas (http://www.netlib.org/blas/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [blas_src]) or by setting
the BLAS_SRC environment variable.
self.calc_info()
C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\system_info.py:1712: UserWarning:
Lapack (http://www.netlib.org/lapack/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [lapack]) or by setting
the LAPACK environment variable.
if getattr(self, '_calc_info_{}'.format(lapack))():
C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\system_info.py:1712: UserWarning:
Lapack (http://www.netlib.org/lapack/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [lapack_src]) or by setting
the LAPACK_SRC environment variable.
if getattr(self, '_calc_info_{}'.format(lapack))():
C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\dist.py:261: UserWarning: Unknown distribution option: 'define_macros'
warnings.warn(msg)
Traceback (most recent call last):
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\core.py", line 148, in setup
dist.run_commands()
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\dist.py", line 955, in run_commands
self.run_command(cmd)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\dist.py", line 974, in run_command
cmd_obj.run()
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\command\bdist_egg.py", line 163, in run
self.run_command("egg_info")
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\dist.py", line 974, in run_command
cmd_obj.run()
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\command\egg_info.py", line 26, in run
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\dist.py", line 974, in run_command
cmd_obj.run()
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\command\build_src.py", line 142, in run
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\command\build_src.py", line 153, in build_sources
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\command\build_src.py", line 286, in build_library_sources
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\command\build_src.py", line 369, in generate_sources
File "numpy\core\setup.py", line 667, in get_mathlib_info
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\command\config.py", line 243, in try_link
self._check_compiler()
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\command\config.py", line 54, in _check_compiler
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\msvc9compiler.py", line 50, in initialize
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\msvc9compiler.py", line 385, in initialize
vc_env = query_vcvarsall(VERSION, plat_spec)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\msvc.py", line 147, in msvc9_query_vcvarsall
return EnvironmentInfo(arch, ver).return_env()
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\msvc.py", line 1227, in return_env
[self.VCIncludes,
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\msvc.py", line 876, in VCIncludes
return [os.path.join(self.si.VCInstallDir, 'Include'),
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\msvc.py", line 555, in VCInstallDir
raise distutils.errors.DistutilsPlatformError(msg)
distutils.errors.DistutilsPlatformError: Microsoft Visual C++ 14.1 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 195, in setup_context
yield
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 250, in run_setup
_execfile(setup_script, ns)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 45, in _execfile
exec(code, globals, locals)
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\setup.py", line 444, in <module>
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\setup.py", line 436, in setup_package
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\core.py", line 171, in setup
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\__init__.py", line 143, in setup
return distutils.core.setup(**attrs)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\core.py", line 163, in setup
raise SystemExit("error: " + str(msg))
SystemExit: error: Microsoft Visual C++ 14.1 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\command\easy_install.py", line 1144, in run_setup
run_setup(setup_script, args)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 253, in run_setup
raise
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\contextlib.py", line 99, in __exit__
self.gen.throw(type, value, traceback)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 195, in setup_context
yield
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\contextlib.py", line 99, in __exit__
self.gen.throw(type, value, traceback)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 166, in save_modules
saved_exc.resume()
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 141, in resume
six.reraise(type, exc, self._tb)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\_vendor\six.py", line 685, in reraise
raise value.with_traceback(tb)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 154, in save_modules
yield saved
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 195, in setup_context
yield
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 250, in run_setup
_execfile(setup_script, ns)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\sandbox.py", line 45, in _execfile
exec(code, globals, locals)
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\setup.py", line 444, in <module>
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\setup.py", line 436, in setup_package
File "C:\Users\Nawab\AppData\Local\Temp\easy_install-2kmbrdot\numpy-1.17.4\numpy\distutils\core.py", line 171, in setup
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\__init__.py", line 143, in setup
return distutils.core.setup(**attrs)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\lib-python\3\distutils\core.py", line 163, in setup
raise SystemExit("error: " + str(msg))
SystemExit: error: Microsoft Visual C++ 14.1 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\Nawab\AppData\Local\Temp\pip-install-e7lqmamq\pandas\setup.py", line 840, in <module>
**setuptools_kwargs
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\__init__.py", line 142, in setup
_install_setup_requires(attrs)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\__init__.py", line 137, in _install_setup_requires
dist.fetch_build_eggs(dist.setup_requires)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\dist.py", line 586, in fetch_build_eggs
replace_conflicting=True,
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\pkg_resources\__init__.py", line 780, in resolve
replace_conflicting=replace_conflicting
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\pkg_resources\__init__.py", line 1063, in best_match
return self.obtain(req, installer)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\pkg_resources\__init__.py", line 1075, in obtain
return installer(requirement)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\dist.py", line 653, in fetch_build_egg
return cmd.easy_install(req)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\command\easy_install.py", line 679, in easy_install
return self.install_item(spec, dist.location, tmpdir, deps)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\command\easy_install.py", line 705, in install_item
dists = self.install_eggs(spec, download, tmpdir)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\command\easy_install.py", line 890, in install_eggs
return self.build_and_install(setup_script, setup_base)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\command\easy_install.py", line 1158, in build_and_install
self.run_setup(setup_script, setup_base, args)
File "C:\Users\Nawab\Desktop\pypy3.6-v7.2.0-win32\site-packages\setuptools\command\easy_install.py", line 1146, in run_setup
raise DistutilsError("Setup script exited with %s" % (v.args[0],))
distutils.errors.DistutilsError: Setup script exited with error: Microsoft Visual C++ 14.1 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/

Got this solved. numpy is not supported PYPY3 yet, installed pypy then numpy and pandas, worked fine.

I resolved this error in the past by using visual studio and installed only the visual c++ redistribution.
https://visualstudio.microsoft.com/downloads
I hope this may help.

You could try to update setuptools by
pip install --upgrade setuptools
Also, you can see that log suggest you download MCV C++
SystemExit: error: Microsoft Visual C++ 14.1 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/

Related

Tensorboard error: Failed to launch TensorBoard (exited with 1). Contents of stderr:

Can someone help me with this error. I tried uninstalling Tensorflow Tensorboard and reinstalled still I am facing the issue.
ERROR: Failed to launch TensorBoard (exited with 1).
Contents of stderr:
2021-05-29 16:11:25.794509: I tensorflow/stream_executor/platform/default/dso_loader.cc:53] Successfully opened dynamic library cudart64_110.dll
Traceback (most recent call last):
File "c:\users\shara\anaconda3\lib\runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "c:\users\shara\anaconda3\lib\runpy.py", line 85, in _run_code
exec(code, run_globals)
File "C:\Users\shara\anaconda3\Scripts\tensorboard.exe\__main__.py", line 7, in <module>
File "c:\users\shara\anaconda3\lib\site-packages\tensorboard\main.py", line 46, in run_main
app.run(tensorboard.main, flags_parser=tensorboard.configure)
File "c:\users\shara\anaconda3\lib\site-packages\absl\app.py", line 300, in run
_run_main(main, args)
File "c:\users\shara\anaconda3\lib\site-packages\absl\app.py", line 251, in _run_main
sys.exit(main(argv))
File "c:\users\shara\anaconda3\lib\site-packages\tensorboard\program.py", line 276, in main
return runner(self.flags) or 0
File "c:\users\shara\anaconda3\lib\site-packages\tensorboard\program.py", line 292, in _run_serve_subcommand
server = self._make_server()
File "c:\users\shara\anaconda3\lib\site-packages\tensorboard\program.py", line 472, in _make_server
deprecated_multiplexer,
File "c:\users\shara\anaconda3\lib\site-packages\tensorboard\backend\application.py", line 145, in TensorBoardWSGIApp
experimental_middlewares,
File "c:\users\shara\anaconda3\lib\site-packages\tensorboard\backend\application.py", line 253, in __init__
"Duplicate plugins for name %s" % plugin.plugin_name
ValueError: Duplicate plugins for name projector

It may be possible that you still have 2 versions of tensorboard installed.
Here is a script, which will check if there are some problems with your tensorboard and may give you some instructions on how to fix it:
https://raw.githubusercontent.com/tensorflow/tensorboard/master/tensorboard/tools/diagnose_tensorboard.py
I would give it a try.

Continuous Machine Learning pipeline broken by tensorflow requirements installation

I am doing Continuous Machine Learning (https://cml.dev/) on my own GitLab server. My goal is to test the basic Continuous Machine Learning pipeline with python script as an example.
My .gitlab-ci.yml file is a basic one:
stages:
- cml_run
cml:
stage: cml_run
image: dvcorg/cml-py3:latest
script:
- pip3 install -r requirements.txt
- python train.py
- cat metrics.txt >> report.md
- cml-publish confusion_matrix.png --md >> report.md
- cml-send-comment report.md
For pandas,sklearn and Keras in the requirements.txt, there is a successful installation. But I receive a pipeline broken by TensorFlow requirements installation
$ pip3 install -r requirements.txt
Collecting pandas
Downloading pandas-1.0.5-cp36-cp36m-manylinux1_x86_64.whl (10.1 MB)
Collecting sklearn
Downloading sklearn-0.0.tar.gz (1.1 kB)
Collecting keras
Downloading Keras-2.4.3-py2.py3-none-any.whl (36 kB)
Collecting tensorflow
Downloading tensorflow-2.2.0-cp36-cp36m-manylinux2010_x86_64.whl (516.2 MB)
ERROR: Exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/cli/base_command.py", line 188, in _main
status = self.run(options, args)
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/cli/req_command.py", line 185, in wrapper
return func(self, options, args)
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/commands/install.py", line 333, in run
reqs, check_supported_wheels=not options.target_dir
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/resolution/legacy/resolver.py", line 179, in resolve
discovered_reqs.extend(self._resolve_one(requirement_set, req))
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/resolution/legacy/resolver.py", line 362, in _resolve_one
abstract_dist = self._get_abstract_dist_for(req_to_install)
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/resolution/legacy/resolver.py", line 314, in _get_abstract_dist_for
abstract_dist = self.preparer.prepare_linked_requirement(req)
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/operations/prepare.py", line 469, in prepare_linked_requirement
hashes=hashes,
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/operations/prepare.py", line 259, in unpack_url
hashes=hashes,
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/operations/prepare.py", line 130, in get_http_url
link, downloader, temp_dir.path, hashes
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/operations/prepare.py", line 281, in _download_http_url
for chunk in download.chunks:
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/cli/progress_bars.py", line 166, in iter
for x in it:
File "/usr/local/lib/python3.6/dist-packages/pip/_internal/network/utils.py", line 39, in response_chunks
decode_content=False,
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/urllib3/response.py", line 564, in stream
data = self.read(amt=amt, decode_content=decode_content)
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/urllib3/response.py", line 507, in read
data = self._fp.read(amt) if not fp_closed else b""
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/cachecontrol/filewrapper.py", line 65, in read
self._close()
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/cachecontrol/filewrapper.py", line 52, in _close
self.__callback(self.__buf.getvalue())
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/cachecontrol/controller.py", line 309, in cache_response
cache_url, self.serializer.dumps(request, response, body=body)
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/cachecontrol/serialize.py", line 72, in dumps
return b",".join([b"cc=4", msgpack.dumps(data, use_bin_type=True)])
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/msgpack/__init__.py", line 35, in packb
return Packer(**kwargs).pack(o)
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/msgpack/fallback.py", line 936, in pack
self._pack(obj)
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/msgpack/fallback.py", line 920, in _pack
len(obj), dict_iteritems(obj), nest_limit - 1
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/msgpack/fallback.py", line 1021, in _pack_map_pairs
self._pack(v, nest_limit - 1)
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/msgpack/fallback.py", line 920, in _pack
len(obj), dict_iteritems(obj), nest_limit - 1
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/msgpack/fallback.py", line 1021, in _pack_map_pairs
self._pack(v, nest_limit - 1)
File "/usr/local/lib/python3.6/dist-packages/pip/_vendor/msgpack/fallback.py", line 865, in _pack
return self._buffer.write(obj)
MemoryError
Any ideas on how to overcome his issue with CML pipeline on GitLab?

It is difficult to diagnose without knowing more about your .gitlab-ci.yml file. But based on the MemoryError message, it seems runner does not have enough memory to install Tensorflow in addition to your other project dependencies.
You can try installing TF with the --no-cache-dir flag

Renaming the model Directory in Tensorflow

I renamed the model dir from /home/abcd/andrew_model_jul25_tif/ which contained model and summary directories to /home/abcd/andrew_model_sep22/ which contained the same two folders. When I ran the python script it gave me the following error:
Traceback (most recent call last):
File "eval_on_full_image.py", line 127, in <module>
tf.app.run()
File "/home/abcd/virtualenvs/project/local/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 48, in run
_sys.exit(main(_sys.argv[:1] + flags_passthrough))
File "eval_on_full_image.py", line 119, in main
do_eval_on_whole(model_dir, file, file[a:], output_dir)
File "eval_on_full_image.py", line 51, in do_eval_on_whole
saver.restore(sess,tf.train.latest_checkpoint(model_dir))
File "/home/abcd/virtualenvs/project/local/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 1602, in latest_checkpoint
if file_io.get_matching_files(v2_path) or file_io.get_matching_files(
File "/home/abcd/virtualenvs/project/local/lib/python2.7/site-packages/tensorflow/python/lib/io/file_io.py", line 334, in get_matching_files
compat.as_bytes(single_filename), status)
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/home/abcd/virtualenvs/project/local/lib/python2.7/site-packages/tensorflow/python/framework/errors_impl.py", line 466, in raise_exception_on_not_ok_status
pywrap_tensorflow.TF_GetCode(status))
tensorflow.python.framework.errors_impl.NotFoundError: /home/abcd/andrew_model_jul25_tif/model
When I changed the folder's name back to andrew_model_jul25 the script worked. Can changing the folder's name have such an effect?
I'm using the 1.1.0 version of tf, and running it on a GPU.

The problem arises here:
saver.restore(sess,tf.train.latest_checkpoint(model_dir))
Try updating the name of your model_dir variable

Redownloaded custom built tensorflow wheel wont install

I've built Tensorflow with custom SIMD extensions and created a wheel for it. If I simply do pip install /tmp/tensorflow_pkg/tensorflow-1.0.0-cp27-cp27mu-linux_x86_64.wh on the box that I built it on, that works. However if I upload the whl file to cloud storage, and do pip install https://storage.cloud.google.com/path/to/tensorflow-1.0.0-cp27-cp27mu-linux_x86_64.whl I get this error:
Collecting tensorflow==1.0.0 from https://storage.cloud.google.com/path/to/tensorflow-1.0.0-cp27-cp27mu-linux_x86_64.whl
Downloading https://storage.cloud.google.com/path/to/tensorflow-1.0.0-cp27-cp27mu-linux_x86_64.whl
Exception:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/pip/basecommand.py", line 215, in main
status = self.run(options, args)
File "/usr/local/lib/python2.7/site-packages/pip/commands/install.py", line 335, in run
wb.build(autobuilding=True)
File "/usr/local/lib/python2.7/site-packages/pip/wheel.py", line 749, in build
self.requirement_set.prepare_files(self.finder)
File "/usr/local/lib/python2.7/site-packages/pip/req/req_set.py", line 380, in prepare_files
ignore_dependencies=self.ignore_dependencies))
File "/usr/local/lib/python2.7/site-packages/pip/req/req_set.py", line 620, in _prepare_file
session=self.session, hashes=hashes)
File "/usr/local/lib/python2.7/site-packages/pip/download.py", line 821, in unpack_url
hashes=hashes
File "/usr/local/lib/python2.7/site-packages/pip/download.py", line 663, in unpack_http_url
unpack_file(from_path, location, content_type, link)
File "/usr/local/lib/python2.7/site-packages/pip/utils/__init__.py", line 599, in unpack_file
flatten=not filename.endswith('.whl')
File "/usr/local/lib/python2.7/site-packages/pip/utils/__init__.py", line 484, in unzip_file
zip = zipfile.ZipFile(zipfp, allowZip64=True)
File "/usr/local/lib/python2.7/zipfile.py", line 770, in __init__
self._RealGetContents()
File "/usr/local/lib/python2.7/zipfile.py", line 811, in _RealGetContents
raise BadZipfile, "File is not a zip file"
BadZipfile: File is not a zip file
Do I need to configure my build differently somehow?

(capturing the solution as an answer)
The URL used for the download is not correct. The base url needed to be storage.googleapis.com

Pycharm - Package installation on Windows

I have successfully installed anaconda on Windows 7.
Pandas and numpy work fine with IPython notebook and I have verified that anaconda is referenced on the PATH.
Yet, I can not install the pandas package wothin Pycharm.
I am not sure how to proceed.
Install packages failed: Error occurred when installing package pandas.
The following command was executed:
packaging_tool.py install --build-dir C:\Users\mferrini\AppData\Local\Temp\pycharm-packaging5585301427553978431.tmp pandas
The error output of the command:
Downloading/unpacking pandas
Running setup.py egg_info for package pandas
non-existing path in 'numpy\\distutils': 'site.cfg'
non-existing path in 'numpy\\f2py': 'docs'
non-existing path in 'numpy\\f2py': 'f2py.1'
non-existing path in 'numpy\\lib': 'benchmarks'
Running from numpy source directory.
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1526: UserWarning:
Atlas (http://math-atlas.sourceforge.net/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [atlas]) or by setting
the ATLAS environment variable.
warnings.warn(AtlasNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1535: UserWarning:
Blas (http://www.netlib.org/blas/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [blas]) or by setting
the BLAS environment variable.
warnings.warn(BlasNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1538: UserWarning:
Blas (http://www.netlib.org/blas/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [blas_src]) or by setting
the BLAS_SRC environment variable.
warnings.warn(BlasSrcNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1432: UserWarning:
Atlas (http://math-atlas.sourceforge.net/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [atlas]) or by setting
the ATLAS environment variable.
warnings.warn(AtlasNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1443: UserWarning:
Lapack (http://www.netlib.org/lapack/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [lapack]) or by setting
the LAPACK environment variable.
warnings.warn(LapackNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1446: UserWarning:
Lapack (http://www.netlib.org/lapack/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [lapack_src]) or by setting
the LAPACK_SRC environment variable.
warnings.warn(LapackSrcNotFoundError.__doc__)
C:\Python27\lib\distutils\dist.py:267: UserWarning: Unknown distribution option: 'define_macros'
warnings.warn(msg)
Traceback (most recent call last):
File "<string>", line 16, in <module>
File "C:\Users\mferrini\AppData\Local\Temp\pycharm-packaging5585301427553978431.tmp\pandas\setup.py", line 619, in <module>
**setuptools_kwargs)
File "C:\Python27\lib\distutils\core.py", line 111, in setup
_setup_distribution = dist = klass(attrs)
File "build\bdist.win32\egg\setuptools\dist.py", line 239, in __init__
File "build\bdist.win32\egg\setuptools\dist.py", line 263, in fetch_build_eggs
File "build\bdist.win32\egg\pkg_resources.py", line 568, in resolve
File "build\bdist.win32\egg\pkg_resources.py", line 806, in best_match
File "build\bdist.win32\egg\pkg_resources.py", line 818, in obtain
File "build\bdist.win32\egg\setuptools\dist.py", line 313, in fetch_build_egg
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 609, in easy_install
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 639, in install_item
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 825, in install_eggs
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 1031, in build_and_install
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 1019, in run_setup
distutils.errors.DistutilsError: Setup script exited with error: Unable to find vcvarsall.bat
Complete output from command python setup.py egg_info:
non-existing path in 'numpy\\distutils': 'site.cfg'
non-existing path in 'numpy\\f2py': 'docs'
non-existing path in 'numpy\\f2py': 'f2py.1'
non-existing path in 'numpy\\lib': 'benchmarks'
Running from numpy source directory.
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1526: UserWarning:
Atlas (http://math-atlas.sourceforge.net/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [atlas]) or by setting
the ATLAS environment variable.
warnings.warn(AtlasNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1535: UserWarning:
Blas (http://www.netlib.org/blas/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [blas]) or by setting
the BLAS environment variable.
warnings.warn(BlasNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1538: UserWarning:
Blas (http://www.netlib.org/blas/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [blas_src]) or by setting
the BLAS_SRC environment variable.
warnings.warn(BlasSrcNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1432: UserWarning:
Atlas (http://math-atlas.sourceforge.net/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [atlas]) or by setting
the ATLAS environment variable.
warnings.warn(AtlasNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1443: UserWarning:
Lapack (http://www.netlib.org/lapack/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [lapack]) or by setting
the LAPACK environment variable.
warnings.warn(LapackNotFoundError.__doc__)
c:\users\mferrini\appdata\local\temp\easy_install-gartid\numpy-1.9.1\numpy\distutils\system_info.py:1446: UserWarning:
Lapack (http://www.netlib.org/lapack/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [lapack_src]) or by setting
the LAPACK_SRC environment variable.
warnings.warn(LapackSrcNotFoundError.__doc__)
C:\Python27\lib\distutils\dist.py:267: UserWarning: Unknown distribution option: 'define_macros'
warnings.warn(msg)
Traceback (most recent call last):
File "<string>", line 16, in <module>
File "C:\Users\mferrini\AppData\Local\Temp\pycharm-packaging5585301427553978431.tmp\pandas\setup.py", line 619, in <module>
**setuptools_kwargs)
File "C:\Python27\lib\distutils\core.py", line 111, in setup
_setup_distribution = dist = klass(attrs)
File "build\bdist.win32\egg\setuptools\dist.py", line 239, in __init__
File "build\bdist.win32\egg\setuptools\dist.py", line 263, in fetch_build_eggs
File "build\bdist.win32\egg\pkg_resources.py", line 568, in resolve
File "build\bdist.win32\egg\pkg_resources.py", line 806, in best_match
File "build\bdist.win32\egg\pkg_resources.py", line 818, in obtain
File "build\bdist.win32\egg\setuptools\dist.py", line 313, in fetch_build_egg
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 609, in easy_install
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 639, in install_item
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 825, in install_eggs
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 1031, in build_and_install
File "build\bdist.win32\egg\setuptools\command\easy_install.py", line 1019, in run_setup
distutils.errors.DistutilsError: Setup script exited with error: Unable to find vcvarsall.bat
----------------------------------------
Cleaning up...
Command python setup.py egg_info failed with error code 1 in C:\Users\mferrini\AppData\Local\Temp\pycharm-packaging5585301427553978431.tmp\pandas
Storing complete log in C:\Users\mferrini\pip\pip.log

We Keep Coding

sql objective-c vba vb.net react-native apache vue.js tensorflow api pandas

PYPY3 -- Unable to install Pandas - pandas

Got this solved. numpy is not supported PYPY3 yet, installed pypy then numpy and pandas, worked fine.

I resolved this error in the past by using visual studio and installed only the visual c++ redistribution. https://visualstudio.microsoft.com/downloads I hope this may help.

You could try to update setuptools by pip install --upgrade setuptools Also, you can see that log suggest you download MCV C++ SystemExit: error: Microsoft Visual C++ 14.1 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/

Related

Tensorboard error: Failed to launch TensorBoard (exited with 1). Contents of stderr:

Continuous Machine Learning pipeline broken by tensorflow requirements installation

Renaming the model Directory in Tensorflow

Redownloaded custom built tensorflow wheel wont install

Pycharm - Package installation on Windows

Categories

Resources