Bigdata Infotech

airflow learning session

Personalized Medicine: Redefining Cancer Treatment Data Science Machine Learning Project

Airflow for spark batch job for incremental data processing with MYSQL

Seamless Data Integration: From S3 to Snowflake with Jupyter Notebook and Power BI Visualization

integration of s3 snowflakes data generated from kinesis streams on EC2

Integrating EC2, Lambda, Kinesis, EMR, Firehose, and OpenSearch for Advanced Data Visualization

spark streaming docker container kafka fastapi superset mysql cassandra

Devops Cloud AWS basics concepts CICD

AWS lamdba triggers S3,SQS,DynamoDB,APIGateway

Hive Architecture, Metastore DB, Table Types, Partitioning, Bucketing, and Complex Datatypes

Introduction to MapReduce: Distributed Data Processing Simplified

hadop hdfs commands and Mapreduce session 2

sqoop session 1 sqoop import,sqoop import all

json,opencsv serde

spark session3 mysql spark integration

ETL pipeline using Kafka airflow spark docker

spark mysql integration pyspark

Mastering the Linux Command Line: Essential Commands You Need to Know!(Session-1)

Building a Real-Time ETL Pipeline with AWS, Apache Spark, and Snowflake | Adzuna Job Data Project

nifi kafka spark airflow docker ETL pipeline