Data Tech Lead with Java - Fiserv
Alpharetta GA (or) Berkley Hills NJ (or) Washington D.C
Rate :: 75-80/hr
This role needs to be extremely hands on. Highly technical candidates only. Need to have an execution mind set.We can consider all Fiserv locations for this. .Data Tech Leads with minimal Java exposure (aligned with profiles similar to Jithu).
1. Role Overview
Experienced Data Technical Lead to design, develop, and support scalable cloud-based data platforms and streaming data pipelines .
The ideal candidate should possess strong expertise in Databricks, PySpark, Python, Java-based streaming technologies, GitLab CI/CD pipelines, and cloud migration initiatives.
2. Key Responsibilities
- Design and develop scalable Databricks ETL/ELT pipelines (Lakeflow & LakeBase) using Azure Databricks, PySpark, and Python.
- Implement real-time and batch data ingestion frameworks using Kafka and Java-based streaming solutions .
- Develop and optimize data processing workflows in Azure Databricks.
- Integrate and manage data movement between PostgreSQL, YugabyteDB (Cassandra-based NoSQL), and cloud platforms.
- Build reusable frameworks for data ingestion, transformation, validation, and orchestration.
- Develop SQL-based data transformations, reporting datasets, and performance optimization solutions.
- Design and implement GitLab CI/CD pipelines for automated deployment, testing, and release management of Databricks notebooks, jobs, and data pipelines.
- Support Snowflake on-premises to Azure cloud migration initiatives.
- Ensure coding standards, performance tuning, monitoring, and operational stability of data pipelines.
- Develop Power BI dashboards and reports for business intelligence and analytics reporting.
- Develop API automation and integration solutions for data exchange between enterprise systems.
3 . Required Skills.
- Strong experience in Python and PySpark development.
- Hands-on experience with Azure Databricks and databricks SQL.
- Experience in Java-based streaming and ingestion frameworks.
- Strong knowledge of Apache Kafka streaming concepts.
- Experience working with PostgreSQL databases.
- Experience with YugabyteDB or Cassandra-based NoSQL databases.
- Strong SQL development and query optimization skills.
- Hands-on experience with GitLab CI/CD pipeline development and deployment automation.
- Understanding cloud-based data engineering and distributed processing concepts.
- Experience in data migration projects, especially Snowflake on-prem to Azure cloud migration.
- Experience designing enterprise-scale data lake or lakehouse architectures.
- Knowledge of streaming architectures and real-time analytics.
- Familiarity with cloud monitoring and observability tools.
Description: Licensed Practical Nurse (LPN) Second Shift Join our welcoming and newly renovated community at Grand Villa of Englewood, where we foster a family-like environment and create a warm, homelike atmosphere for our residents. We are seeking a dedicated...
...Are you ready to embark on an exciting journey within the dynamic food-service industry? Randolph Restaurant Group, the proud franchisee of Bojangles OPCO, Inc., is on the lookout for vibrant, outgoing individuals to join our ever-expanding team. With 12 thriving restaurants...
Job ID: 289549 Store Name/Number: CA-Pacific Commons (0462) Address: (Pacific Commons Shopping Center) 43550 Christy Street, Suite #R1A, Fremont, CA 94538, United States (US) Hourly/Salaried: Hourly (Non-Exempt) Full Time/Part Time: Full Time Position Type...
...MRI education program Required Licenses ARRT (MR) or ARMRIT at hire (Preferred) OR ARRT in one of these Radiography (R)/Nuclear Medicine (N)/Radiation Therapy (T)/ Sonography (S) required and get ARRT (MR) or ARMRIT within 24 months of hire date Current BLS...
...creations delivered in a warm and inviting atmosphere. Fresh Baguette in Germantown, MD is currently looking for Overnight Delivery Drivers . Our drivers deliver fresh baked products to wholesale customers across the Washington, DC, Maryland, and Virginia area. You...