{"id":604,"date":"2012-06-13T19:14:11","date_gmt":"2012-06-14T01:14:11","guid":{"rendered":"http:\/\/benincosa.com\/blog\/?p=604"},"modified":"2014-11-19T11:24:53","modified_gmt":"2014-11-19T17:24:53","slug":"nexus-1000v-layer-3","status":"publish","type":"post","link":"https:\/\/benincosa.com\/?p=604","title":{"rendered":"Nexus 1000v Layer 3"},"content":{"rendered":"

Layer 3 mode is the recommended way<\/a> to configure VSM to VEM communication in the Nexus 1000v. \u00a0 Layer 3 mode keeps things simple and easier to troubleshoot.<\/p>\n

I kept my design very simple. \u00a0There’s one VLAN (509) that I run my ESXi hosts on. \u00a0The IP addresses are 192.168.40.xxx. \u00a0Just to give you an example:<\/p>\n

vCenter: 192.168.40.2
\nESXi Host1: 192.168.40.101
\nESXi Host2: 192.168.40.102
\n…
\nN1kv: 192.168.40.31<\/p>\n

Using this I had a simple uplink port-profile defined:<\/p>\n

nexus1000v(config-port-prof)# show port-profile name uplink\r\n\r\nport-profile uplink\r\n type: Ethernet\r\n description: \r\n status: enabled\r\n max-ports: 32\r\n min-ports: 1\r\n inherit:\r\n config attributes:\r\n  switchport mode trunk\r\n  switchport trunk allowed vlan 1,501,506,509-510,714,3967\r\n  channel-group auto mode on mac-pinning\r\n  no shutdown\r\n evaluated config attributes:\r\n  switchport mode trunk\r\n  switchport trunk allowed vlan 1,501,506,509-510,714,3967\r\n  channel-group auto mode on mac-pinning\r\n  no shutdown\r\n assigned interfaces:\r\n  port-channel1\r\n  port-channel2\r\n  Ethernet3\/1\r\n  Ethernet3\/2\r\n  Ethernet4\/1\r\n  Ethernet4\/2\r\n port-group: uplink\r\n system vlans: 1,501,506,509-510,714\r\n capability l3control: no\r\n capability iscsi-multipath: no\r\n capability vxlan: no\r\n capability l3-vn-service: no\r\n port-profile role: none\r\n port-binding: static<\/pre>\n
And a simple management port-profile:<\/p>\n
nexus1000v(config-port-prof)# show port-profile name management\r\n\r\nport-profile management\r\n type: Vethernet\r\n description: \r\n status: enabled\r\n max-ports: 32\r\n min-ports: 1\r\n inherit:\r\n config attributes:\r\n  switchport mode access\r\n  switchport access vlan 509\r\n  no shutdown\r\n evaluated config attributes:\r\n  switchport mode access\r\n  switchport access vlan 509\r\n  no shutdown\r\n assigned interfaces:\r\n  Vethernet1\r\n  Vethernet4\r\n port-group: management\r\n system vlans: 509\r\n capability l3control: yes\r\n capability iscsi-multipath: no\r\n capability vxlan: no\r\n capability l3-vn-service: no\r\n port-profile role: none\r\n port-binding: static<\/pre>\n
I had everything set up right… I thought. \u00a0The only problem was (before, not in the output above) is that I couldn’t see my VEMs!  They were all hooked up in vCenter and I was even running traffic through them.  But no VEMs:<\/p>\n
nexus1000v(config)# show module vem\r\nNo Virtual Ethernet Modules found.<\/pre>\n
I finally stumbled upon this nice document<\/a> and realized I hadn’t enabled l3control. \u00a0Doing that:<\/p>\n
nexus1000v(config-port-prof)# capability l3control<\/pre>\n
And Bam! \u00a0Everything worked:<\/p>\n
nexus1000v(config-port-prof)# show module vem\r\nMod  Ports  Module-Type                       Model               Status\r\n---  -----  --------------------------------  ------------------  ------------\r\n3    248    Virtual Ethernet Module           NA                  ok\r\n4    248    Virtual Ethernet Module           NA                  ok\r\n\r\nMod  Sw                  Hw      \r\n---  ------------------  ------------------------------------------------  \r\n3    4.2(1)SV1(5.1a)     VMware ESXi 5.0.0 Releasebuild-469512 (3.0)      \r\n4    4.2(1)SV1(5.1a)     VMware ESXi 5.0.0 Releasebuild-469512 (3.0)      \r\n\r\nMod  MAC-Address(es)                         Serial-Num\r\n---  --------------------------------------  ----------\r\n3    02-00-0c-00-03-00 to 02-00-0c-00-03-80  NA\r\n4    02-00-0c-00-04-00 to 02-00-0c-00-04-80  NA\r\n\r\nMod  Server-IP        Server-UUID                           Server-Name\r\n---  ---------------  ------------------------------------  --------------------\r\n3    192.168.40.101   00000000-0000-0000-cafe-00000000000f  192.168.40.101\r\n4    192.168.40.102   00000000-0000-0000-cafe-00000000000e  192.168.40.102<\/pre>\n
 <\/p>\n","protected":false},"excerpt":{"rendered":"
Layer 3 mode is the recommended way to configure VSM to VEM communication in the Nexus 1000v. \u00a0 Layer 3 mode keeps things simple and easier to troubleshoot. I kept my design very simple. \u00a0There’s one VLAN (509) that I run my ESXi hosts on. \u00a0The IP addresses are 192.168.40.xxx. \u00a0Just to give you an…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[990,147],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/posts\/604"}],"collection":[{"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/benincosa.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=604"}],"version-history":[{"count":2,"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/posts\/604\/revisions"}],"predecessor-version":[{"id":606,"href":"https:\/\/benincosa.com\/index.php?rest_route=\/wp\/v2\/posts\/604\/revisions\/606"}],"wp:attachment":[{"href":"https:\/\/benincosa.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=604"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/benincosa.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=604"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/benincosa.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=604"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}