Job details
Job type full-time
Full job description
At human we are all about keeping it humanWe are the global leader in bot mitigationWe protect more than 200 enterprises—including the largest internet platforms—from sophisticated bots by verifying the humanity of nearly one trillion online interactions every weekThe most sophisticated bots look and act like humans when they click on ads, visit websites, fill out forms, take over accounts, and commit payment fraudWe stop themFounded in 2012 in a brooklyn sci-fi bookstore, our bot mitigation platform protects enterprises from the sophisticated bots that threaten themIt’s an ongoing war that we fight passionately every dayJoin our mission to stop bots, disrupt the economics of cybercrime, and keep it humanThe data engineering team is responsible for the primary organs and arteries of our systemThe team’s mission is to consistently deliver a world-class data platform that enables our security researchers, threat intel analysts, and data scientists to quickly and reliably detect malicious non-human activityYou will be solving a wide range of problems from finding more efficient ways to research sophisticated botnets to delivering only the most critical and impactful insights to our customers as fast as possible, so they can take actionBy joining the data platform team at human you will gain a deep understanding of how our products and services work all the way from signal collection to customer reports and are able to make a major impact on cleaning up the internetYou will be responsible for the evolution of a platform that will grow in scale by 100x (current volume is over 1 pb) to 1000x, ensure that our data can never be used for ill by anyone (e.gPrivacy and security are at the core of the system design), and incorporate the latest ml and fraud research techniques.
What you will do:
Architect, design, build, test, deploy and maintain reliable, scalable systems and applications to process our current and expected future loads
Partner closely with security researchers, threat intel analysts, and data scientists to understand how they work and uncover new ways to enhance and amplify their analysis
Handle the ingestion and usability of a snowflake data warehouse that ingests and process very high volume near real time data
Partner with our operations teams to debug and resolve critical issues and participate in an on-call support rotation for critical production applications
Empower our partners to automate and enhance their day to day data requirements (finance, marketing, sales, product management, etc.) using frameworks and libraries.
Work with a team of passionate engineers who love to learn, experiment, and push the limits of modern technology
Use devops practices and principles to build and demonstrate ci/cd pipelines.
Participate in git-based code reviews and design reviews at project to architecture scale
Participate in building a thoughtful culture that emphasizes lean principles and optimizes for deep work, teamwork, and doing the best work of your career
Who you are:
You can develop software in python, understanding both the theoretical concepts of the language as well as how to write well-documented well-tested code
You have experience in designing and architecting big data eco systems using large data sets (order of 100 billion interactions and multiple petabytes) and hands on experience developing them
You have proven track record to design processes that support data transformation, data structures, metadata, dependency and workflow management.
You have experience efficiently analyzing and extracting key insights from large (terabytes/petabytes) datasets.
You have ability to benchmark systems, analyze system bottlenecks and propose solutions to eliminate them
You have the ability to clearly articulate pros and cons of various technologies and platforms and to document use cases, solutions and recommendations.
You can own medium to-large sized features all the way through from technical design to deployment in production
You have experience actively contributing to a project on a team of 3 or more people and ability to work with cross functional teams
You can provide updates on the scope and state of work, proactively identify issues that you are facing, and learn to anticipate roadblocks that may arise
You find time to improve some aspect of a codebase or process through writing small utilities or integrating an open source tool
These are some additional skills that the team has developed and use regularly but are not required for new hires (other than a burning desire to learn them when needed):
Experience with java
Experience automating the deployment of distributed software to cloud environments like aws, azure or gcp (which likely also means you know some combination of kubernetes, docker, and/or terraform)
Knowledge of the snowflake database, primarily its use as a data warehouse
Sophisticated sql knowledge and working familiarity with a variety of sql and no-sql databases.
Able to do basic *nix system administration
Benefits & perks
Unlimited pto
Private medical and dental insurance for all full-time employees
Fully paid parental leave
Learning & development fund
Phenomenal coaching from senior leaders and challenging development opportunities
Monthly internet, phone bill, and meal stipend to support working remotely during covid-19
Company-sponsored talkspace membership for you and your family
Life at human: our hq office is located in the heart of new york cityWe are growing the company deliberately with a keen eye towards maintaining values that embody diversity, lifestyle, and career growthWe are doing substantial work, and we need people to join our mighty teamWe are proud of our overwhelmingly positive presence on glassdoor and built in nycWe have offices located in nyc, dc, victoria, and londonWe understand it takes a diverse team of passionate, curious, and creative people to solve the challenges involved in protecting the internetOur dynamic team of humans have incredible perspectives to share, just as we know you do, and we take great pride in being an equal opportunity workplaceWe will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employmentPlease contact us to request accommodation.
