Discussion:
[theano-users] Memory issues
Frédéric Bastien
2017-08-08 12:59:52 UTC
Permalink
This error was fixed in the master. Update again.
'/home/ericmjl/anaconda/envs/bayesian/lib/python3.6/site-packages/theano/tensor/c_code/dimshuffle.c'
I checked - `c_code/` is not installed when running `python setup.py
install`. I'm a bit unfamiliar with how C-code gets installed - surely an
__init__.py isn't needed?
Thank you for your reply, Frederic!
I have 16GB of RAM on my CPU.
Just to confirm, on GitHub, the dev version of Theano is the current
master branch, is that correct? Would it be sufficient for me to do a
"development" install (`python setup.py develop`), or is something more
complicated needed?
On Tue, Aug 1, 2017 at 9:37 AM, Frédéric Bastien <
The problem is g++ that is missing memory. How much CPU ram your
computer have?
Can you update to the dev version of THeano on github? It could have
this already fixed and is stable.
Fred
Hey everybody,
I have an issue with Theano memory allocation on my GPU when using
PyMC3. I can't seem to figure out how to debug this. I'm not sure if this
problem is reproducible on other machines yet, but at least I know it's
consistently happening on my own machine (desktop ASUS i7 + GTX 1080). Is
there a good way to debug this and figure out how to make things work?
https://github.com/ericmjl/bayesian-analysis-recipes/blob/master/multiclass-classification-neural-network.ipynb
.
- PyMC3 version 3.1, installed from master and tracking latest commits.
- Theano version 0.9.0
- libgpuarray 0.6.8
- pygpu 0.6.8
- NVIDIA GTX1080 with driver version 384.59
- Ubuntu 16.04.2
The error message shows up in the notebook at the cell with the
```python
samp_ppc = pm.sample_ppc(trace, samples=500)
```
```python
0%| | 0/100 [00:00<?, ?it/s]Problem occurred during
/usr/bin/g++ -shared -g -O3 -fno-math-errno -Wno-unused-label -Wno-
unused-variable -Wno-write-strings -march=broadwell -mmmx -mno-3dnow -msse
-msse2 -msse3 -mssse3 -mno-sse4a -mcx16 -msahf -mmovbe -maes -mno-sha -mpclmul
-mpopcnt -mabm -mno-lwp -mfma -mno-fma4 -mno-xop -mbmi -mbmi2 -mno-tbm
-mavx -mavx2 -msse4.2 -msse4.1 -mlzcnt -mrtm -mhle -mrdrnd -mf16c -mfsgsbase
-mrdseed -mprfchw -madx -mfxsr -mxsave -mxsaveopt -mno-avx512f -mno-avx512er
-mno-avx512cd -mno-avx512pf -mno-prefetchwt1 -mclflushopt -mxsavec -mxsaves
-mno-avx512dq -mno-avx512bw -mno-avx512vl -mno-avx512ifma -mno-avx512vbmi
-mno-clwb -mno-pcommit -mno-mwaitx --param l1-cache-size=32 --param l1-
cache-line-size=64 --param l2-cache-size=8192 -mtune=generic -
DNPY_NO_DEPRECATED_API=NPY_1_7_API_VERSION -m64 -fPIC -I/home/ericmjl/
anaconda/envs/bayesian/lib/python3.6/site-packages/pygpu -I/home/
ericmjl/anaconda/envs/bayesian/lib/python3.6/site-packages/numpy/core/include
-I/home/ericmjl/anaconda/envs/bayesian/include -I/home/ericmjl/anaconda
/envs/bayesian/lib/python3.6/site-packages/numpy/core/include -I/home/
ericmjl/anaconda/envs/bayesian/include/python3.6m -I/home/ericmjl/
github/software/Theano/theano/gof -L/home/ericmjl/anaconda/envs/
bayesian/lib -L/home/ericmjl/anaconda/envs/bayesian/lib -fvisibility=hidden
-o /home/ericmjl/.theano/compiledir_Linux-4.10--generic-x86_64-with-
debian-stretch-sid-x86_64-3.6.1-64/tmp595s6h99/
ma82e960c1010cb6654d49168be28c6b4.so /home/ericmjl/.theano/
compiledir_Linux-4.10--generic-x86_64-with-debian-stretch-sid-x86_64-
3.6.1-64/tmp595s6h99/mod.cpp -lgpuarray -lpython3.6m
ERROR (theano.gof.cmodule): [Errno 12] Cannot allocate memory
```
```python
---------------------------------------------------------------------------
OSError Traceback (most recent call
last)
<ipython-input-16-f76c5aea1bad> in <module>()
----> 2 samp_ppc = pm.sample_ppc(trace, samples=100)
~/github/software/pymc3/pymc3/sampling.py in sample_ppc(trace, samples,
model, vars, size, random_seed, progressbar)
534 ppc[var.name].append(var.distribution.random(
point=param,
--> 535
size=size))
536
537
--
---
You received this message because you are subscribed to the Google Groups "theano-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to theano-users+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Continue reading on narkive:
Loading...