Data engineer – IT online
The data engineer is responsible for maintaining, improving, cleaning up and manipulating data in the company’s operational and analysis databases.
The data engineer works with the company’s software engineers, data analysis teams, data scientists, and data warehouse engineers to understand database requirements and assist with implementation, analyze performance, and troubleshoot existing issues.
The data engineer must be an expert in SQL development and support data and analytics in database design, data flow and analysis activities.
The position of data engineer also plays a key role in developing and deploying innovative big data platforms for advanced analytics and data processing.
The data engineer defines and creates the data pipelines that enable faster, better and data-based decision-making in the company.
Required qualifications of the data engineer:
The data engineer must have a bachelor’s degree in computer science, applied mathematics, engineering, or any other technology-related field. An equivalent work experience is also accepted for the position.
A candidate for the position has at least 5 years of professional experience as a database engineering support staff or database engineering administrator in a fast-paced and complex business environment. The candidate also has experience working with MySQL databases and Microsoft [URL Removed] The candidate must demonstrate experience in handling large and complex data sets as well as experience in the analysis of data volumes using basic Microsoft Excel functions, e.g. B. Macros and pivot tables. A candidate for this position will also have experience working with Internet technologies such as SaaS, IaaS and PaaS. The candidate has in-depth work and conceptual knowledge in the creation and maintenance of physical and logical data models and experience with Tableau, Domo or other business intelligence tools. A suitable candidate for the position also has systems management skills in monitoring, disaster recovery, backup, automated testing, automated schema migration, and continuous deployment.
Technologically savvy / analytical skills:
The data engineer must also have exceptional analytical skills showing fluency in the use of tools such as MySQL and strong Python, Shell, Java, PHP and T-SQL programming skills. He must also be tech savvy and demonstrate strong computer skills. The candidate must also be able to develop databases using SSIS packages, T-SQL, MSSQL and MySQL [URL Removed] The candidate also has the ability to design, build, and maintain the company’s ETL pipeline and data warehouse. The candidate will also demonstrate knowledge of data modeling and query performance optimization on SQL Server, MySQL, Redshift, Postgres, or similar platforms.
Desired work experience:
- 5 to 10 years of data analysis / data warehousing