Loading on-prem DB to Fabric Lakehouse with Synapse Spark

Опубликовано: 02 Ноябрь 2024
на канале: Data Gravity
2,250
56

In this video, you will learn how to load data from on-prem SQL Server database, securely and privately, to Microsoft Fabric Lakehouse using Synapse Spark, without having to poke holes in your on-prem firewalls.


Please find below all the shell scripts used for IP Forwarder:

1. To change current user to root
sudo su -

2. To enable IP Forwarding flag
echo "1" > /proc/sys/net/ipv4/ip_forward

3. Declare variable: Ethernet Interface
ETH_IF=eth0

4. Declare variable: Front-end port number
FE_PORT=1443

5. Declare variable: Destination IP
DEST_IP=10.0.4.7

6. Declare variable: Destination port number
DEST_PORT=1443

7. Create DNAT Rule
iptables -t nat -A PREROUTING -p tcp -i ${ETH_IF} --dport ${FE_PORT} -j DNAT --to ${DEST_IP}:${DEST_PORT}

8. Create SNAT Rule
iptables -t nat -A POSTROUTING -o ${ETH_IF} -j MASQUERADE

9. Check IP Tables Configuration
iptables -t nat -L


-----------------------

Follow me on Linked-In:
  / vengat83