Data Engineer

Дата размещения вакансии: 09.09.2024
Работодатель: CloudSquad
Уровень зарплаты:
от 300000 до 450000 RUR
Город:
Москва
Требуемый опыт работы:
От 3 до 6 лет

CloudSquad is a strategic technology consulting company focused on helping clients realize the full potential of their business by utilizing the Cloud and implementing AI. We review and analyze client systems and work with them to design and implement solutions that enable our clients to take advantage of the latest technology available.

We are seeking a highly skilled Data Engineer to join the CloudSquad team. As a Data Engineer you will be responsible for designing, developing, and maintaining robust, scalable data infrastructure and pipelines for our clients. You will play a crucial role in ensuring the availability and integrity of data for our clients in areas of analytics, reporting, and business intelligence applications.

Key Responsibilities:

  • Design, implement, and optimize end-to-end data pipelines for the extraction, transformation, and loading (ETL) of structured and unstructured data.

  • Collaborate with cross-functional teams to understand data requirements and translate them into scalable pipeline solutions.

  • Design and implement efficient data models that support business requirements.

  • Work on database architecture and schema design, ensuring data integrity and performance.

  • Integrate data from various sources, both internal and external, to create a unified and comprehensive view of the organization's data.

  • Implement and maintain data integration solutions for seamless data flow.

  • Develop and implement data quality checks and monitoring processes.

  • Enforce data governance policies and standards to ensure data accuracy, consistency, and security.

  • Optimize database performance to ensure efficient and timely access to data.

  • Identify and fix performance bottlenecks in data processing workflows.

  • Implement and maintain data security measures to protect sensitive information.

  • Collaborate with security teams to ensure compliance with data privacy regulations.

  • Work closely with data scientists, analysts, and other stakeholders to understand data use cases and provide assistance.

  • Collaborate with client IT and business teams to align data solutions with organizational goals.

  • Create and maintain comprehensive documentation for data processes, architectures, and workflows.

  • Share knowledge and best practices with the broader team to foster a culture of continuous learning.

Qualifications:

  • Bachelor’s/Master’s degree in Computer Science, Information Technology, or a related field.

  • Proven experience as a Data Engineer or similar role.

  • Proficiency in SQL and experience with relational databases (e.g. MySQL, PostgreSQL, Oracle).

  • Strong programming skills, especially in languages like Python, Java, or Scala.

  • Familiarity with big data technologies and frameworks (e.g. Apache Hadoop, Spark).

  • Knowledge of data warehousing concepts and Cloud-based data platforms.

Preferred Skills:

  • Experience with Cloud platforms such as Google Cloud, AWS or Azure.

  • Knowledge of NoSQL databases (e.g. MongoDB, Cassandra).

  • Familiarity with data visualization tools (e.g. Looker, Tableau, Power BI).

  • Experience with Terraform for infrastructure as code (IaC), enabling the provisioning and management of Cloud resources, and ensuring consistency and repeatability across environments.

  • Deep understanding of platform engineering principles, including designing and building robust, scalable, and fault-tolerant data platforms to support diverse data processing and analytics requirements.

  • Understanding of data science and machine learning concepts.

Benefits:

  • 100% remote.

  • Competitive salary and benefits package.

  • Opportunities for professional development and training.

  • Support for certifications or further education related to Cloud technologies.

  • Opportunities for career advancement within the rapidly growing environment.

  • Collaborative and innovative work environment.

Join CloudSquad, a fast-growing company, with a strong technology culture, and an innovative work environment where you can work on the cutting-edge of technology. If you have a passion for solving complex technical problems, we want to hear from you! Apply now and play a crucial role in shaping the future success of CloudSquad and our clients!