Azure Data Engineer Job at Sansar Tec, United States

aVllL1pTLzV6MllLNVVoYWlFTEQ1VkR0ckE9PQ==
  • Sansar Tec
  • United States

Job Description

 

Role: Azure Data Engineer

Location: Iselin NJ

3 Days Hybrid from Day 1

Look for 15 years with Credit Risk OR Capital Market Experience.

 

Must Have:

  • Snowflake
  • SQL
  • Python
  • ADF
  • Azure Data Bricks
  • PySpark
  • Data Warehouse Concepts

 

Job Description :

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

 

Major Responsibilities:

  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

 

Skills:

  • 9+ years Python coding experience.
  • 5+ years - SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.

Job Tags

Full time,

Similar Jobs

Green Meadows Partners

Smartsheet Solutions Specialist Job at Green Meadows Partners

 ...Job Description Job Description Are you a Smartsheet wizard who loves turning chaos into clarity? Do you get a thrill out of building powerful dashboards, automating workflows, and helping teams work smarternot harder? Green Meadows Partners is proud to be leading... 

Delta Defense

Part Time Account Executive - Outside Sales - Anchorage AK - Firearms/Self Defense Industry (Anchorage) Job at Delta Defense

 ...in rural markets through education, outreach, and relationship-building. Maintain and expand relationships with partner ranges, firearm instructors, and retailers. Deliver compelling group presentations and drive awareness of USCCA Membership benefits. Support... 

Priority Dispatch

Mini/Cargo Van Owner Operator Delivery Driver needed Job at Priority Dispatch

 ...Owner Operator Delivery Driver needed in Woodstock, IL 60098 Diamond Expedited is currently looking for Independent Contractors (ICs) with a Minivan or Cargo Van to perform afternoon route/ small package deliveries in the Woodstock area. What we have... 

Garcia Automotive Group of Santa Fe

Car Detailer Mercedes Benz of Santa Fe Job at Garcia Automotive Group of Santa Fe

If people are telling you that you have one of the cleanest, well kept vehicles in your neighborhood, chances are you enjoy doing it! How would you like to get paid for doing what you enjoy? We offer career advancement opportunities within NM's largest independently owned...

Blue Star Partners LLC

Pipeline Engineer (Contract) Job at Blue Star Partners LLC

 ...Job Title: Pipeline Engineer Location: Canonsburg, PA (Hybrid: Three times a week) Rate: $40 $60/hr (W2) Contract Duration: 6 Months Contract Type: W2 (Applicants must be authorized to work in the U.S.; no sponsorship available) Qualifications: ~ Bachelor...