<p><span style="padding: 3px 10px; border-radius: 5px; color: #ffffff; font-weight: bold; display: inline-block; background-color: #ff0000;"> External Email - Use Caution </span></p><p></p><div dir="auto">Or you can use memmapping by passing a filename string to `preload`, which will be used for temporary storage.<div dir="auto"><br></div><div dir="auto">Eric</div><div dir="auto"><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Sun, Dec 16, 2018, 11:37 Alexandre Gramfort <<a href="mailto:alexandre.gramfort@inria.fr">alexandre.gramfort@inria.fr</a> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> External Email - Use Caution <br>
<br>
hi Karin,<br>
<br>
loading the file in memory will double the size as we do computations<br>
in double precision.<br>
<br>
I would see if you can use preload=False on read. The only thing that<br>
can be problematic<br>
is filtering which requires preload=True. In this case, I would<br>
process data by chunks. You can<br>
use the raw.crop method for this.<br>
<br>
HTH<br>
Alex<br>
<br>
<br>
<br>
On Sun, Dec 16, 2018 at 5:22 PM Karin Westin <<a href="mailto:karin.westin85@gmail.com" target="_blank" rel="noreferrer">karin.westin85@gmail.com</a>> wrote:<br>
><br>
> External Email - Use Caution<br>
><br>
> Hi!<br>
> I'd like to preload raw-fif files (~40 min recording, sample rate 5000 Hz, 10.2 GB) but it seems I'm running out of memory (RAM 16GB, 2x8 GB). Do I simply need more memory or is there any other way to tweak the loading of the raw files?<br>
><br>
> Best,<br>
> Karin<br>
> _______________________________________________<br>
> Mne_analysis mailing list<br>
> <a href="mailto:Mne_analysis@nmr.mgh.harvard.edu" target="_blank" rel="noreferrer">Mne_analysis@nmr.mgh.harvard.edu</a><br>
> <a href="https://mail.nmr.mgh.harvard.edu/mailman/listinfo/mne_analysis" rel="noreferrer noreferrer" target="_blank">https://mail.nmr.mgh.harvard.edu/mailman/listinfo/mne_analysis</a><br>
<br>
_______________________________________________<br>
Mne_analysis mailing list<br>
<a href="mailto:Mne_analysis@nmr.mgh.harvard.edu" target="_blank" rel="noreferrer">Mne_analysis@nmr.mgh.harvard.edu</a><br>
<a href="https://mail.nmr.mgh.harvard.edu/mailman/listinfo/mne_analysis" rel="noreferrer noreferrer" target="_blank">https://mail.nmr.mgh.harvard.edu/mailman/listinfo/mne_analysis</a><br>
</blockquote></div>