[ad_1]
- Develop and maintain efficient data pipeline architecture.
- Construct intricate data sets that align with functional and non-functional business requirements.
- Identify, plan, and implement internal process enhancements, such as automation of manual processes, data delivery optimization, and infrastructure redesign for improved scalability.
- Establish the necessary infrastructure for efficient data extraction, transformation, and loading from diverse data sources using SQL and AWS ‘big data’ technologies.
- Design analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other crucial business performance metrics.
- Collaborate with stakeholders including Executives, Product Managers, Data and Design teams to address data-related technical challenges and fulfill data infrastructure needs.
- Maintain data security and separation across national boundaries, encompassing multiple data centers and AWS regions.
- Develop data tools for the analytics and data science teams, assisting them in optimizing our product’s position as an innovative industry leader.
- Collaborate with data and analytics experts to enhance functionality within our data systems.
- Communicate with clients to elucidate task requirements.
- Conceptualize and create infrastructure to facilitate access and analysis of big data.
- Refine existing frameworks to enhance their functionality.
- Test and validate structures to ensure their suitability.
- Prepare raw data for manipulation by data scientists.
- Detect and rectify errors in work.
- Ensure that work remains backed up and accessible.
- Stay current with industry standards and technological advancements that enhance the quality of outputs.
Requirements
- Bachelor’s degree in data engineering, big data analytics, computer engineering, or a related field.
- 5 years of proven experience as a data engineer, software developer, or in a similar role.
- Proficiency in Python, C++, Java, R, and SQL.
- Familiarity with Hadoop or equivalent technologies.
- Strong analytical and problem-solving skills.
- Ability to work independently and collaboratively.
- Detail-oriented and conscientious approach to tasks.
- Capacity to manage a pipeline of responsibilities with minimal supervision.
[ad_2]
Source link
Leave a Reply