External Email - Use Caution

Absolutely, Ruopeng, happy to provide. Would the best avenue for sharing these files be the FTP drop (into transfer/incoming) or some other avenue?

________________________________ From: freesurfer-bounces@nmr.mgh.harvard.edu freesurfer-bounces@nmr.mgh.harvard.edu on behalf of Ruopeng Wang rpwang@nmr.mgh.harvard.edu Sent: Thursday, August 22, 2019 8:16 AM To: Freesurfer support list freesurfer@nmr.mgh.harvard.edu Subject: Re: [Freesurfer] freeview crash -- petsc error when opening volume

Hi Tristan,

Would it be possible to send us the files and the command-line you run?

Best, Ruopeng

On Aug 21, 2019, at 12:18 PM, TRISTAN J PAUTSCH <tpautsch@wisc.edumailto:tpautsch@wisc.edu> wrote:

External Email - Use Caution

Adding more details provided by my user:

The crash only happens when loading surface files, either via the -f flag from the CLI or directly through the GUI. Could this be an issue with the surface files or the manner in which they are created?

________________________________ From: freesurfer-bounces@nmr.mgh.harvard.edumailto:freesurfer-bounces@nmr.mgh.harvard.edu <freesurfer-bounces@nmr.mgh.harvard.edumailto:freesurfer-bounces@nmr.mgh.harvard.edu> on behalf of TRISTAN J PAUTSCH <freesurfer-bounces@nmr.mgh.harvard.edumailto:freesurfer-bounces@nmr.mgh.harvard.edu> Sent: Tuesday, August 20, 2019 2:35 PM To: freesurfer@nmr.mgh.harvard.edumailto:freesurfer@nmr.mgh.harvard.edu <freesurfer@nmr.mgh.harvard.edumailto:freesurfer@nmr.mgh.harvard.edu> Subject: [Freesurfer] freeview crash -- petsc error when opening volume

External Email - Use Caution

Greetings all, I'll try to keep this succinct.

I'm attempting to deploy FreeSurfer on Ubuntu 18.04 servers here at the lab. I used the stable 6.0/CentOS 6 download, in addition to the dev version of freeview per the .../fswiki/UpdateFreeview instructions. All dependencies have ostensibly been satisfied, all libs from 'ldd freeview.bin' installed. Freeview launches fine and stays open when launched alone, however attempting to open a volume (either through the GUI or directly via the CLI) causes a crash and the following error about 5-8 seconds after launching (brain images begin to populate, then crash):

---

[0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range [0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [0]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/petsc-as/documentation/troubleshooting.html#Sig... ERROR: or try http://valgrind.org on linux or man libgmalloc on Apple to find memory corruption errors [0]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [0]PETSC ERROR: to get more information on the crash. [0]PETSC ERROR: --------------------- Error Message ------------------------------------ [0]PETSC ERROR: Signal received! [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Petsc Release Version 2.3.3, Patch 13, Thu May 15 17:29:26 CDT 2008 HG revision: 4466c6289a0922df26e20626fd4a0b4dd03c8124 [0]PETSC ERROR: See docs/changes/index.html for recent updates. [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting. [0]PETSC ERROR: See docs/index.html for manual pages. [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Unknown Name on a linux-gnu named xxxxxxx by xxxxxxx Tue Aug 20 13:44:15 2019 [0]PETSC ERROR: Libraries linked from /autofs/space/lyon_006/pubsw/Linux2-2.3-x86_64/packages/petsc/2.3.3-p13/src/petsc-2.3.3-p13/lib/linux-gnu-c-opt [0]PETSC ERROR: Configure run at Tue Aug 10 15:01:59 2010 [0]PETSC ERROR: Configure options --with-debugging=no --with-cc=gcc --with-fc=g77 --download-f-blas-lapack=0 --download-mpich=1 --with-mpi=1 --with-x=0 --with-gnu-copyright-code=0 --with-shared=0 COPTFLAGS=-O3 CXXOPTFLAGS=-O3 FOPTFLAGS=-O3 [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: User provided function() line 0 in unknown directory unknown file [unset]: aborting job: application called MPI_Abort(MPI_COMM_WORLD, 59) - process 0 Segmentation fault (core dumped)

---

I've seen a number of other posts on the mailing list about this, but all of them I could find either end abruptly without a solution or with an unanswered request for more info.

Happy to provide any additional information or anything that may aid in the resolution of this issue.

Thanks everyone, ~T _______________________________________________ Freesurfer mailing list Freesurfer@nmr.mgh.harvard.edumailto:Freesurfer@nmr.mgh.harvard.edu https://mail.nmr.mgh.harvard.edu/mailman/listinfo/freesurfer

Hi Tristan,

Thanks for the files. I have no problem loading them with the latest dev build and stable 6.0 build. I do not have an Ubuntu system, though.

If I’m not mistaken you use dev version of freeview binary along with stable 6.0 FS binary. Is that correct? Is there any chance you can try installing the whole FS dev package?

Ruopeng

On Aug 22, 2019, at 12:20 PM, TRISTAN J PAUTSCH tpautsch@wisc.edu wrote:

    External Email - Use Caution        

Ruopeng,

I've uploaded the files to the FTP drop (transfer/incoming/freesurfer_data.tar.gz). The command my user is running against these files is:

freeview -v brainmask.mgz T1.mgz -f lh.white:edgecolor=yellow lh.pial:edgecolor=magenta rh.white:edgecolor=yellow rh.pial:edgecolor=magenta

We can also replicate the error by opening freeview and opening all the above files sequentially through the GUI.

Thank you! Tristan

From: freesurfer-bounces@nmr.mgh.harvard.edu freesurfer-bounces@nmr.mgh.harvard.edu on behalf of Ruopeng Wang rpwang@nmr.mgh.harvard.edu Sent: Thursday, August 22, 2019 8:16 AM To: Freesurfer support list freesurfer@nmr.mgh.harvard.edu Subject: Re: [Freesurfer] freeview crash -- petsc error when opening volume

Hi Tristan,

Would it be possible to send us the files and the command-line you run?

Best, Ruopeng

...

On Aug 21, 2019, at 12:18 PM, TRISTAN J PAUTSCH <tpautsch@wisc.edu mailto:tpautsch@wisc.edu> wrote:

    External Email - Use Caution        

Adding more details provided by my user:

The crash only happens when loading surface files, either via the -f flag from the CLI or directly through the GUI. Could this be an issue with the surface files or the manner in which they are created?

From: freesurfer-bounces@nmr.mgh.harvard.edu mailto:freesurfer-bounces@nmr.mgh.harvard.edu <freesurfer-bounces@nmr.mgh.harvard.edu mailto:freesurfer-bounces@nmr.mgh.harvard.edu> on behalf of TRISTAN J PAUTSCH <freesurfer-bounces@nmr.mgh.harvard.edu mailto:freesurfer-bounces@nmr.mgh.harvard.edu> Sent: Tuesday, August 20, 2019 2:35 PM To: freesurfer@nmr.mgh.harvard.edu mailto:freesurfer@nmr.mgh.harvard.edu <freesurfer@nmr.mgh.harvard.edu mailto:freesurfer@nmr.mgh.harvard.edu> Subject: [Freesurfer] freeview crash -- petsc error when opening volume

    External Email - Use Caution        

Greetings all, I'll try to keep this succinct.

I'm attempting to deploy FreeSurfer on Ubuntu 18.04 servers here at the lab. I used the stable 6.0/CentOS 6 download, in addition to the dev version of freeview per the .../fswiki/UpdateFreeview instructions. All dependencies have ostensibly been satisfied, all libs from 'ldd freeview.bin' installed. Freeview launches fine and stays open when launched alone, however attempting to open a volume (either through the GUI or directly via the CLI) causes a crash and the following error about 5-8 seconds after launching (brain images begin to populate, then crash):

---

[0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range [0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [0]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/petsc-as/documentation/troubleshooting.html#Sig... http://www.mcs.anl.gov/petsc/petsc-as/documentation/troubleshooting.html#Signal[0]PETSC ERROR: or try http://valgrind.org http://valgrind.org/ on linux or man libgmalloc on Apple to find memory corruption errors [0]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [0]PETSC ERROR: to get more information on the crash. [0]PETSC ERROR: --------------------- Error Message ------------------------------------ [0]PETSC ERROR: Signal received! [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Petsc Release Version 2.3.3, Patch 13, Thu May 15 17:29:26 CDT 2008 HG revision: 4466c6289a0922df26e20626fd4a0b4dd03c8124 [0]PETSC ERROR: See docs/changes/index.html for recent updates. [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting. [0]PETSC ERROR: See docs/index.html for manual pages. [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Unknown Name on a linux-gnu named xxxxxxx by xxxxxxx Tue Aug 20 13:44:15 2019 [0]PETSC ERROR: Libraries linked from /autofs/space/lyon_006/pubsw/Linux2-2.3-x86_64/packages/petsc/2.3.3-p13/src/petsc-2.3.3-p13/lib/linux-gnu-c-opt [0]PETSC ERROR: Configure run at Tue Aug 10 15:01:59 2010 [0]PETSC ERROR: Configure options --with-debugging=no --with-cc=gcc --with-fc=g77 --download-f-blas-lapack=0 --download-mpich=1 --with-mpi=1 --with-x=0 --with-gnu-copyright-code=0 --with-shared=0 COPTFLAGS=-O3 CXXOPTFLAGS=-O3 FOPTFLAGS=-O3 [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: User provided function() line 0 in unknown directory unknown file [unset]: aborting job: application called MPI_Abort(MPI_COMM_WORLD, 59) - process 0 Segmentation fault (core dumped)

---

I've seen a number of other posts on the mailing list about this, but all of them I could find either end abruptly without a solution or with an unanswered request for more info.

Happy to provide any additional information or anything that may aid in the resolution of this issue.

Thanks everyone, ~T _______________________________________________ Freesurfer mailing list Freesurfer@nmr.mgh.harvard.edu mailto:Freesurfer@nmr.mgh.harvard.edu https://mail.nmr.mgh.harvard.edu/mailman/listinfo/freesurfer https://mail.nmr.mgh.harvard.edu/mailman/listinfo/freesurfer

---

Freesurfer mailing list Freesurfer@nmr.mgh.harvard.edu https://mail.nmr.mgh.harvard.edu/mailman/listinfo/freesurfer

External Email - Use Caution

Some final bits of troubleshooting information for future readers, since I'm assuming this issue will now get lost in the sauce...I'll probably try compiling everything from scratch at some point, but my hopes aren't particularly high

I manually compiled the missing libs to get the CentOS7 version of FS-dev freeview running on Ubuntu 18, and ultimately the same errors occur. As well, I replicated this behavior on a separate Ubuntu 18 machine in the environment, this time using a different lab's T1/brainmask/surface files. It would definitely seem like there is some sort of hard incompatibility with newer versions of freeview and loading surface files on top of volumes in Ubuntu 18.

For what it's worth, it's not evident that any other part of FS has an issue; all CLI tools seem to work just fine.

Tristan

________________________________ From: TRISTAN J PAUTSCH tpautsch@wisc.edu Sent: Friday, August 23, 2019 11:38 AM To: Freesurfer support list freesurfer@nmr.mgh.harvard.edu Subject: Re: [Freesurfer] freeview crash -- petsc error when opening volume

Good morning Ruopeng, thank you for your continued assistance!

Unfortunately, I get the same error using the CentOS6 dev version. I tried the CentOS7 dev version, however this led to a series of library errors, the majority of which are unsolvable on Ubuntu 18 without individually compiling each necessary library (sym-linking newer libraries does not work).

I wanted to ensure I provide the most details possible, so I also installed FS 5.3.0 and tested the files...interestingly, they opened just fine, no errors at all.

This leads me to believe there is some strange incompatibility between Ubuntu 18 and the 6.x/dev version of FS (at least when it comes to surface files), specifically related to PETSC. Is there anything else I can do to help troubleshoot?

Tristan

________________________________ From: freesurfer-bounces@nmr.mgh.harvard.edu freesurfer-bounces@nmr.mgh.harvard.edu on behalf of Ruopeng Wang rpwang@nmr.mgh.harvard.edu Sent: Thursday, August 22, 2019 5:00 PM To: Freesurfer support list freesurfer@nmr.mgh.harvard.edu Subject: Re: [Freesurfer] freeview crash -- petsc error when opening volume

Hi Tristan,

Thanks for the files. I have no problem loading them with the latest dev build and stable 6.0 build. I do not have an Ubuntu system, though.

If I’m not mistaken you use dev version of freeview binary along with stable 6.0 FS binary. Is that correct? Is there any chance you can try installing the whole FS dev package?

Ruopeng

On Aug 22, 2019, at 12:20 PM, TRISTAN J PAUTSCH <tpautsch@wisc.edumailto:tpautsch@wisc.edu> wrote:

External Email - Use Caution

Ruopeng,

I've uploaded the files to the FTP drop (transfer/incoming/freesurfer_data.tar.gz). The command my user is running against these files is:

freeview -v brainmask.mgz T1.mgz -f lh.white:edgecolor=yellow lh.pial:edgecolor=magenta rh.white:edgecolor=yellow rh.pial:edgecolor=magenta

We can also replicate the error by opening freeview and opening all the above files sequentially through the GUI.

Thank you! Tristan

________________________________ From: freesurfer-bounces@nmr.mgh.harvard.edumailto:freesurfer-bounces@nmr.mgh.harvard.edu <freesurfer-bounces@nmr.mgh.harvard.edumailto:freesurfer-bounces@nmr.mgh.harvard.edu> on behalf of Ruopeng Wang <rpwang@nmr.mgh.harvard.edumailto:rpwang@nmr.mgh.harvard.edu> Sent: Thursday, August 22, 2019 8:16 AM To: Freesurfer support list <freesurfer@nmr.mgh.harvard.edumailto:freesurfer@nmr.mgh.harvard.edu> Subject: Re: [Freesurfer] freeview crash -- petsc error when opening volume

Hi Tristan,

Would it be possible to send us the files and the command-line you run?

Best, Ruopeng

On Aug 21, 2019, at 12:18 PM, TRISTAN J PAUTSCH <tpautsch@wisc.edumailto:tpautsch@wisc.edu> wrote:

External Email - Use Caution

Adding more details provided by my user:

The crash only happens when loading surface files, either via the -f flag from the CLI or directly through the GUI. Could this be an issue with the surface files or the manner in which they are created?

________________________________ From: freesurfer-bounces@nmr.mgh.harvard.edumailto:freesurfer-bounces@nmr.mgh.harvard.edu <freesurfer-bounces@nmr.mgh.harvard.edumailto:freesurfer-bounces@nmr.mgh.harvard.edu> on behalf of TRISTAN J PAUTSCH <freesurfer-bounces@nmr.mgh.harvard.edumailto:freesurfer-bounces@nmr.mgh.harvard.edu> Sent: Tuesday, August 20, 2019 2:35 PM To: freesurfer@nmr.mgh.harvard.edumailto:freesurfer@nmr.mgh.harvard.edu <freesurfer@nmr.mgh.harvard.edumailto:freesurfer@nmr.mgh.harvard.edu> Subject: [Freesurfer] freeview crash -- petsc error when opening volume

External Email - Use Caution

Greetings all, I'll try to keep this succinct.

I'm attempting to deploy FreeSurfer on Ubuntu 18.04 servers here at the lab. I used the stable 6.0/CentOS 6 download, in addition to the dev version of freeview per the .../fswiki/UpdateFreeview instructions. All dependencies have ostensibly been satisfied, all libs from 'ldd freeview.bin' installed. Freeview launches fine and stays open when launched alone, however attempting to open a volume (either through the GUI or directly via the CLI) causes a crash and the following error about 5-8 seconds after launching (brain images begin to populate, then crash):

---

[0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range [0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [0]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/petsc-as/documentation/troubleshooting.html#Sig... ERROR: or try http://valgrind.orghttp://valgrind.org/ on linux or man libgmalloc on Apple to find memory corruption errors [0]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [0]PETSC ERROR: to get more information on the crash. [0]PETSC ERROR: --------------------- Error Message ------------------------------------ [0]PETSC ERROR: Signal received! [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Petsc Release Version 2.3.3, Patch 13, Thu May 15 17:29:26 CDT 2008 HG revision: 4466c6289a0922df26e20626fd4a0b4dd03c8124 [0]PETSC ERROR: See docs/changes/index.html for recent updates. [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting. [0]PETSC ERROR: See docs/index.html for manual pages. [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Unknown Name on a linux-gnu named xxxxxxx by xxxxxxx Tue Aug 20 13:44:15 2019 [0]PETSC ERROR: Libraries linked from /autofs/space/lyon_006/pubsw/Linux2-2.3-x86_64/packages/petsc/2.3.3-p13/src/petsc-2.3.3-p13/lib/linux-gnu-c-opt [0]PETSC ERROR: Configure run at Tue Aug 10 15:01:59 2010 [0]PETSC ERROR: Configure options --with-debugging=no --with-cc=gcc --with-fc=g77 --download-f-blas-lapack=0 --download-mpich=1 --with-mpi=1 --with-x=0 --with-gnu-copyright-code=0 --with-shared=0 COPTFLAGS=-O3 CXXOPTFLAGS=-O3 FOPTFLAGS=-O3 [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: User provided function() line 0 in unknown directory unknown file [unset]: aborting job: application called MPI_Abort(MPI_COMM_WORLD, 59) - process 0 Segmentation fault (core dumped)

---

I've seen a number of other posts on the mailing list about this, but all of them I could find either end abruptly without a solution or with an unanswered request for more info.

Happy to provide any additional information or anything that may aid in the resolution of this issue.

Thanks everyone, ~T _______________________________________________ Freesurfer mailing list Freesurfer@nmr.mgh.harvard.edumailto:Freesurfer@nmr.mgh.harvard.edu https://mail.nmr.mgh.harvard.edu/mailman/listinfo/freesurfer

_______________________________________________ Freesurfer mailing list Freesurfer@nmr.mgh.harvard.edumailto:Freesurfer@nmr.mgh.harvard.edu https://mail.nmr.mgh.harvard.edu/mailman/listinfo/freesurfer