OPEN POSITION:
Data Engineer (US Remote/Antwerp, Belgium/Bangalore or Pune, India)
Position Summary
Data Engineer with experience in building high-performing, scalable, enterprise-grade platforms. Hands-on experience in platform/product development is a must. The Data Engineer will be responsible for dealing with all aspects of the data engineering/processing on a data pipeline. Your goal is to guarantee the reliable extraction, transformation and loading of data, to manage databases, develop and implement software to establish relationships between the different data sources and guarantee the quality and integrity of the data. The ideal candidate must be a problem solver and have expertise in Big Data technologies, Azure stack. The ideal candidate must have hands-on experience in efficient data loading, storing, cleaning, and processing. Candidates must be familiar with various technologies and have a good understanding of their relative strengths and shortcomings.
Personal Qualities
Whether you will be working on a group project or simply participating in a meeting, you will need to be a team player and you will need to be able to communicate with people from different cultures and backgrounds, showing respect to others and be willing to work towards achieving a common goal. You should be able to flexibly move from one project to another and prioritize in order to take care of the most pressing matters first. You should know how to allocate tasks, as well as be able to delegate assignments to others when needed. Having the expertise to think of new ideas and follow through is a desirable skill, judging a situation correctly, making conclusions and coming up with a practical solution to a problem.
Responsibilities
- Design and develop high-volume, low-latency platforms/applications for mission-critical systems, delivering high availability and performance.
- Understand business requirements and actively provide inputs from a data perspective.
- Understand the underlying data and flow of data.
- Build simple to complex pipelines and data flows.
- Work with other Azure stack modules like Azure Data Lakes, Azure Databricks, Azure Cosmos DB, etc.
- Recognize and adapt to the changes in processes as the project evolves in size and function.
- Perform other duties as assigned.
Skills Needed
- Strong analytic skills related to working with structured and unstructured data sets.
- Proficient in writing T-SQL Stored Procedures, Functions, Cursors, Tables, Constraints, Views, Indexes & Sequence. Experience in data scraping from website and ingest to cloud data platform will be an added advantage. Strong knowledge in analyzing performance issues, optimizing performance in ADF & Azure SQL.
- Excellent interpersonal/communication skills in English (both oral/written) to communicate at various levels with clarity & precision.
- Knowledge of the pharma domain and understanding of the clinical trial process will be an added advantage.
Qualifications Needed
- Bachelor’s degree or higher in Computer Engineering, Computer Science or related field.
- Seven (7) + years of experience in a data engineering role.
- Four (4) + years of experience in programming languages (e.g., Spark, Python, C#).
- Two (2) + years of hands-on experience on Azure Data Factory V2, which covers DF Pipeline development, deployment, administration & management of ARM template packages.
- Knowledge of the pharma domain and understanding of the clinical trial process will be an added advantage.
Anju Software is an Equal Opportunity Employer. Anju Software provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, or status as a veteran. Anju Software complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities.
