We are seeking an outstanding Data Engineer to join the Sovico’s Data Team. This team is responsible for sourcing, curating and maintaining the datasets which are used by multiple teams across Sovico.
You help build the infrastructure to answer questions with data, using software engineering best practices, data management fundamentals, data storage principles, and recent advances in distributed systems
You help drive the architecture and technology choices that enable a world-class user experience
You develop expertise in a broad range of Sovico’s data resources and know when, how, and which to use and which not to use
You encourage the organization to adopt next-generation data architecture strategies, proposing both data flows and storage solutions
You are comfortable with a degree of ambiguity and willing to develop quick proof of concepts, iterate and improve
You create extensible designs and easy to maintain solutions with the long term vision in mind
You have an understanding and empathy for business objectives, and continually align your work with those objectives and seek to deliver business value. You listen effectively.
You are comfortable presenting your findings to large groups
As a Data Engineer on Sovico Data team, you will design, develop, implement, test, and operate large-scale, high-volume, high-performance data structures for analytics and deep learning. Implement data ingestion routines both real time and batch using best practices in data modelling, ETL/ELT processes leveraging AWS technologies and Big data tools.
Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions that work well within the overall data architecture. Analyse source data systems and drive best practices in source teams. Participate in the full development life cycle, end-to-end, from design, implementation and testing, to documentation, delivery, support, and maintenance. Produce comprehensive, usable dataset documentation and metadata. Evaluate and make decisions around dataset implementations designed and proposed by peer data engineers. Evaluate and make decisions around the use of new or existing software products and tools. Mentor junior data engineers.
Yêu Cầu Công Việc
A desire to work in a collaborative, intellectually curious environment.
Degree in Computer Science, Engineering, Mathematics, or a related field and 5-7+ years industry experience
Must have one year of experience in the following skill(s):
Developing and operating large-scale data structures for business intelligence analytics using: ETL/ELT processes; OLAP technologies; data modelling; SQL;
Experience with at least one relational database technology such as Redshift, Oracle, MySQL or MS SQL
Experience with at least one massively parallel processing data technology such as Redshift, Spark or Hadoop based big data solution