View source for Multiple NICs in the same subnetwork

__NOTOC__

<div>This document explains how to configure different network layouts that involve having multiple network interfaces in the same subnet. Each layout has specific setup steps.<br/>
In the examples we use:

*Host 1 to represent the storage server
*while Host 2 represents the machine that communicates with the storage server.
</div><br/>
'''IMPORTANT NOTE'''
<div>As a rule, we suggest that you avoid using network layouts that need multiple interfaces in the same subnet, because they may cause some network services to be unstable. Additionally, it might result in routing issues – for example, a packet sent through eth0 may get a reply from eth1. If you want to improve network performance, please consider using bonding or iSCSI multipathing scenarios instead.</div><br/>
== Scenario 1 ==
<div>Host 1 and Host 2 are connected through a switch. They have multiple network interfaces in the same subnet to communicate with each other.</div><div>[[File:Multiple NICs in the same subnetwork Scenario1.png|none|Multiple NICs in the same subnetwork Scenario1.png]]</div><div style="text-align: center"></div>
==== CONFIGURATION ====
<div>
*The need for static routing depends on the service being used.
*If Host 2 initiates the connection, Host 1 may not need static routing, but it is better to set it up for more reliability.
*If Host 1 initiates the connection, Host 1 needs static routing. This also applies if Host 2 is another storage server.
</div><br/>
==== POSSIBLE ISSUES ====
<div>Without static routing, Host 1 will use only the interface that comes first in the routing table (for example, eth1) for all connections it starts.</div><div>[[File:Multiple NICs in the same subnetwork scenario1-issue1.png]]</div><br/><div>The interface that comes first in the routing table is essential for Host 1 to initiate any connections. If it fails, Host 1 will lose this ability.</div><div>[[File:Multiple NICs in the same subnetwork scenario1-issue2.png]]</div><div>You can prevent this problem by configuring static routing for each interface.</div><div>[[File:Multiple NICs in the same subnetwork scenario1-issue3.png]]</div><br/><div>To configure static routing in the GUI, go to "System Settings", then select the "Network" tab and click the "Add static routing" button in the "Static routing manager" section.</div><br/><div>[[File:Multiple NICs static-routing-GUI.png]]</div><br/><div>The 'New route' window will appear. The fields should be filled in with the appropriate values.</div><br/><div>[[File:Multiple NICs static-routing-new-route.png]]</div><br/><div>'''Network/Host IP''': enter the IP address of the network card of the target host<br/>'''Netmask''': when we use a static route for a specific end host, the subnet mask is 32-bit (255.255.255.255)<br/>'''Interface''': from the drop-down menu, select the interface from which communication is to be established.</div><br/><div>Below is an example static route configuration for three NICs in the same subnet.</div><br/><div>[[File:Multiple NICs static-routing-table.png]]</div><br/>
== Scenario 2 ==
<div>Host 1 and Host 2 are connected through a switch. They have multiple network interfaces in the same subnet to communicate with each other. Additionally,&nbsp; Host 1 also has an interface for WAN access.</div><br/><div>[[File:Multiple NICs scenario2 conf1.png]]</div><br/>
==== CONFIGURATION ====
<div>
*We strongly suggest that you use a different subnet for the WAN interface than the other interfaces. In such a case, this layout will be similar to Layout 1 and you can follow the same setup steps.
*But, unlike Layout 1, this layout always needs a gateway on the WAN interface (see the image below)
*Please check the “Possible issues” section for Layout 1 for problems that may also happen in this layout.
</div><br/><div>[[File:Multiple NICs scenario2 conf2.png]]</div><br/><div>To set up the gateway, please press CTRL+ALT+N on the system console and choose the interface. Then, select "Gateway."</div><br/><div>[[File:Network-setting.png]]</div><br/>
== Scenario 3 ==
<div>Host 1 and Host 2 are directly connected. For better connectivity with this host, there are several network interfaces within the same subnetwork.</div><br/><div>[[File:Multiple NICs scenario3.png]]</div><br/>
==== CONFIGURATION ====
<div>
*This scenario requires static routing to be set up on Host 1 and, depending on the operating system, on Host 2 as well.
*A local output interface must be assigned to every remote IP. This rule applies to both hosts.
</div><br/>
==== POTENTIAL ISSUES ====
<div>If Host 1 does not use static routing, it will always initiate connections through the interface that appears first in the routing table (in the example below, eth1).</div><div>[[File:Multiple NICs scenario3 issue1.png]]</div><br/><div>You can prevent this issue by configuring static routing for each interface.</div><br/><div>[[File:Multiple NICs scenario3 issue2.png]]</div><br/>
[[Category:ZFS and data storage articles]]