Azure Databricks & PySpark Principal Consultant
Infosys
Work from Office
Full Time
Min. 12 yearsJob Description
Azure Databricks & PySpark Principal Consultant
12-16 years of IT experience with strong Data Engineering expertise. Hands-on experience in Azure Databricks and PySpark development. Strong knowledge of Azure Data Factory (ADF). Expertise in SQL and Data Warehousing concepts. Experience with Azure Data Lake Storage (ADLS Gen2). Strong understanding of Spark architecture and performance tuning. Experience designing and implementing enterprise-scale data pipelines. Knowledge of CI/CD and Agile delivery practices. Design, develop, and optimize large-scale data pipelines using Azure Databricks and PySpark. Build and maintain ETL/ELT workflows using Azure Data Factory. Develop scalable data processing frameworks for batch and near real-time data ingestion. Implement data transformation, cleansing, and enrichment processes. Work with large-scale structured and unstructured datasets in Azure Data Lake. Optimize Spark jobs for performance, scalability, and cost efficiency. Collaborate with business stakeholders, architects, and analytics teams to deliver data solutions. Ensure data quality, security, governance, and compliance standards are met. Provide production support, troubleshoot issues, and drive continuous improvements. Mentor junior team members and contribute to technical solution design.Job role
Job requirements
About company
Similar jobs you can apply for
Business OperationsOperation Manager
FLYSPIRE
Field JobFull TimeMin. 2 years
Basic EnglishData Collector
Manpower GroupsWork from OfficeFull TimeAny experienceBasic EnglishBIM Modeler
Hr ConsortiumWork from OfficeFull TimeMin. 3 yearsGood (Intermediate / Advanced) English
Pre Sales & Tender Specialist
Aditek Systems Private LimitedField JobFull TimeMin. 2 yearsGood (Intermediate / Advanced) English
Quality Control Manager
Pathshodh Healthcare Private LimitedWork from OfficeFull TimeMin. 5 yearsGood (Intermediate / Advanced) EnglishDot Net Developer(freshers)
Schematonics Research And Development India (Opc) Private LimitedWork from OfficeFull TimeFreshers onlyBasic EnglishYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 12 to 16 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!