[SOLVED] Memory Issue when Importing GraphML

Get help with your data
Post Reply [phpBB Debug] PHP Warning: in file [ROOT]/vendor/twig/twig/lib/Twig/Extension/Core.php on line 1275: count(): Parameter must be an array or an object that implements Countable
mikemcan
Posts:2
Joined:21 Dec 2011 17:49
[phpBB Debug] PHP Warning: in file [ROOT]/vendor/twig/twig/lib/Twig/Extension/Core.php on line 1275: count(): Parameter must be an array or an object that implements Countable
[SOLVED] Memory Issue when Importing GraphML

Post by mikemcan » 21 Dec 2011 19:17

Hi, newbie here, but I've read all I can find on the install instructions for increasing the heap size in the graph.conf file (https://gephi.org/users/install/), which was my initial focus to solve this problem. I'm trying to import a 450MB GraphML file into 0.8beta. I'm running on a Win7 64-bit OS and a 64-bit JVM, and the system has 16GB of memory. The file has ~40K nodes and 700K edges.

I originally got the message telling me to increase my max heap size to 1300MB, which I did, but I still get the same message. The install instructions refer to the ability to use more memory on a 64-bit system, so I tried to go from 1300 to 2056, but then the JVM cannot be created. How do I take advantage of all the memory on my system?

kenshiro
Posts:4
Joined:21 Dec 2011 11:22
[phpBB Debug] PHP Warning: in file [ROOT]/vendor/twig/twig/lib/Twig/Extension/Core.php on line 1275: count(): Parameter must be an array or an object that implements Countable

Re: Memory Issue when Importing GraphML

Post by kenshiro » 23 Dec 2011 15:42

You could just up the total memory dedicated to gephi on the conf file up to 15GB. That is what I did, Im processing a 1m nodes 3m edges graphml file with gephi, my memory usage got up to 11GB however it is really SLOW even though i have an 8 core i7 processor and 16GB of memory.

User avatar
mbastian
Gephi Architect
Posts:728
Joined:10 Dec 2009 10:11
Location:San Francisco, CA
[phpBB Debug] PHP Warning: in file [ROOT]/vendor/twig/twig/lib/Twig/Extension/Core.php on line 1275: count(): Parameter must be an array or an object that implements Countable

Re: Memory Issue when Importing GraphML

Post by mbastian » 30 Dec 2011 02:53

Mike if you have 16 GB ram on your computer Gephi should have proposed to increase the heap size to near this limit. The fact it proposed you 1300 mo tells me you might be running Gephi with a 32-bit JVM. The 32-bit is limited to ~1500mo for the heap size, whereas the 64-bit scales to 16gb and more. Check your Java configuration to make sure your default JVM is 64-bit.

mikemcan
Posts:2
Joined:21 Dec 2011 17:49
[phpBB Debug] PHP Warning: in file [ROOT]/vendor/twig/twig/lib/Twig/Extension/Core.php on line 1275: count(): Parameter must be an array or an object that implements Countable

Re: Memory Issue when Importing GraphML

Post by mikemcan » 05 Jan 2012 19:50

Finally figured this one out. The system had both the 32-bit and 64-bit JRE installed, and apparently Gephi was using the 32-bit to run. I edited the conf file to edit the path to the JRE and all was well. Thanks for the help.

Post Reply
[phpBB Debug] PHP Warning: in file [ROOT]/vendor/twig/twig/lib/Twig/Extension/Core.php on line 1275: count(): Parameter must be an array or an object that implements Countable
[phpBB Debug] PHP Warning: in file [ROOT]/vendor/twig/twig/lib/Twig/Extension/Core.php on line 1275: count(): Parameter must be an array or an object that implements Countable