{"id":57,"date":"2009-09-16T00:03:27","date_gmt":"2009-09-16T06:03:27","guid":{"rendered":"http:\/\/benincosa.com\/blog\/?p=57"},"modified":"2014-11-19T11:27:19","modified_gmt":"2014-11-19T17:27:19","slug":"change-gpfs-to-run-over-infiniband-instead-of-gigabit-ethernet-gbe","status":"publish","type":"post","link":"https:\/\/benincosa.com\/?p=57","title":{"rendered":"Change GPFS to run over InfiniBand instead of Gigabit Ethernet (GbE)"},"content":{"rendered":"

I have a cluster where GPFS is running over the Gb Ethernet. To make it so that GPFS goes over InfiniBand Ido the following:<\/p>\n

mmshutdown -a\r\nmmchnode --daemon-interface=compute001-ib0 -N compute001<\/pre>\n
That did it for one node.\u00a0 To do it for all nodes:<\/p>\n
for i in $(nodels compute); do mmchnode --daemon-interface=$i-ib0 -N $i; done<\/pre>\n
Alternatively, I could have just made a spec file called \/tmp\/foo with the contents:<\/p>\n
s01 --daemon-interface=s01-ib0\r\ns02 --daemon-interface=s02-ib0<\/pre>\n
Then run:<\/p>\n
mmchnode -S \/tmp\/foo<\/pre>\n
Once finished, I run mmlscluster and see that all the nodes that I wanted are now communicating over the InfiniBand.\u00a0 GPFS is so easy!<\/p>\n
Then, start things back up:<\/p>\n
mmstartup -a<\/pre>\n
And you’re off to the races.<\/p>\n","protected":false},"excerpt":{"rendered":"
I have a cluster where GPFS is running over the Gb Ethernet. To make it so that GPFS goes over InfiniBand Ido the following: mmshutdown -a mmchnode –daemon-interface=compute001-ib0 -N compute001 That did it for one node.\u00a0 To do it for all nodes: for i in $(nodels compute); do mmchnode –daemon-interface=$i-ib0 -N $i; done Alternatively, I…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/posts\/57"}],"collection":[{"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/benincosa.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=57"}],"version-history":[{"count":3,"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/posts\/57\/revisions"}],"predecessor-version":[{"id":60,"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/posts\/57\/revisions\/60"}],"wp:attachment":[{"href":"https:\/\/benincosa.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=57"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/benincosa.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=57"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/benincosa.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=57"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}