Job details
Job type full-time
Full job description
We are looking for a savvy data engineer to join our growing team of analytics expertsYou will be responsible for expanding and optimizing our data and data pipeline architecture, as well as critical data flowsYour background is one of an experienced data pipeline builder and data gatherer who enjoys optimizing data systems and building them from the ground up.
As the data engineer, you will support our data analysts and data scientists on data initiatives and will ensure that optimal data delivery architecture is consistent throughout ongoing projectsYou are self-directed and comfortable supporting the data needs of multiple teams, systems and productsIn addition, you are excited by the prospect of optimizing or even re-designing the company’s data architecture to support next generation architectures and processes.
To help with your efforts, you can expect a comprehensive technology stack, talented co-workers, an aws-based analytics environment with a comprehensive array of on-line and off-line data and a maturing data science team developing algorithms to enhance business performance and the customer experienceBecause of its dedication and efforts, lands’ end is an internet retailer top 50 company, and a great part of your future.
Responsibilities
Create and maintain an optimal data pipeline architecture.
Assemble large, complex datasets that meet functional and non-functional business requirements.
Identify, design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build reports for production, convert existing reports in various formats including sas and upgrade to current open-source technologies.
Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using sql and aws glue technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Keep the data separated and secure across national boundaries.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Share technical knowledge and mentor data engineering staff and others within the broader analytics and e-commerce communities.
Qualifications
Advanced working sql knowledge and experience working with relational databases, query authoring (sql) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures and datasets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytical skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large, disconnected datasets.
Working knowledge of message queuing and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
5+ years of experience in a data or software engineering role, who has attained a bs in computer science or related fieldApplicable graduate work a plus.
You should also have experience using the following software and tools:
5+ years of experience with linux
3+ years of experience with object-oriented/object function scripting languages: python, scala, java 8, etc.
Experience with big data tools: hadoop, spark, kafka/kinesis, etc2+ years preferred.
Experience with relational sql and nosql databases, including oracle, postgres/netezza and elasticsearch.
Experience with aws cloud services: ec2, emr, ecs/eks, redshift, elasticache, glue etl preferred.
Experience with bi tools: kibana, tableau, etc.
Experience with restful api and docker preferred.
Experience with airflow and mlflow.
Equal opportunity employer/protected veterans/individuals with disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicantHowever, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor���s legal duty to furnish information41 cfr 60-1.35(c)
