Ahrefs is looking for an infrastructure engineer with deep knowledge of Linux and distributed systems to help take care of its distributed crawler and ensure all systems are up and running 24/7. Working experience with bare-metal servers and ability to participate in daily on-call rotation are required.
Our system is a big part of custom OCaml code and also employs third-party technologies - Debian, ELK, Puppet, Ansible and anything else that will solve the task at hand. In this role, be prepared to deal with 100+ petabytes storage cluster, 3,000+ bare-metal servers, experimental large-scale deployments and all kinds of software bugs and hardware deviations on a daily basis.
If you possess a healthy desire to automate everything while being able to quickly resolve urgent issues manually, then we want you! We strive to keep humans away from doing repetitive jobs that can be done by computers and focus instead on foreseeing problems and defining programmatic means to handle them.
Basic Requirements:
- Deep understanding of operating systems and networks fundamentals
- Practical knowledge of Linux userspace and kernel internals
- Working experience with bare-metal servers
- Participation in on-call rotation (4 hours every weekday + one weekend per month)
The ideal candidate is expected to:
- Understand the whole technology stack at all levels: from network and user-space code to OS internals and hardware
- Independently deal with and investigate infrastructure issues on live production systems including dealing with hardware problems and interact with datacenters
- Develop internal automation - monitoring, setup, statistics
- Have the ability to foresee potential problems and prevent them from happening. Apply first-aid reaction to infrastructure failures when necessary
- Help developers with deployment and integration
- Make well-reasoned technical choices and take responsibility for it
- Approach problems with a practical mindset and suppress perfectionism when time is a priority
- Setup automatic systems to control infrastructure
- Possess a healthy detestation for complex shell scripts
- Be ready to work in a small team and take responsible independent decisions
- Working knowledge of Ocaml is a plus
Who We Are
Ahrefs runs an internet-scale bot that crawls the whole web 24/7, storing huge volumes of information to be indexed and structured in a timely fashion. Our backend system is powered by a custom petabyte-scale distributed key-value storage to accommodate all that data coming in at high speed. With this data, Ahrefs builds analytics services for end-users in the Search Engine Optimization (SEO) space and a web-scale search platform.
We are a lean and robust team who strongly believe that better technology leads to better solutions for real-world problems.
Our motto is "first do it, then do it right, then do it better".
Ahrefs does not engage with agencies or third party recruitment solutions for the roles we hire for. If at any point we need help, we'll let you know!
私たちのこと
Ahrefsはインターネット規模のボットを運用しており、24時間365日ウェブ全体をクロールし、膨大な量の情報を蓄積し、タイムリーにインデックス化、構造化しています。バックエンドシステムには、ペタバイトスケールのカスタム分散型キーバリューストレージが採用されており、高速で入ってくるすべてのデータに対応しています。これらのデータをもとに、Ahrefsは検索エンジン最適化(SEO)分野のエンドユーザー向け分析サービスや、ウェブスケールの検索プラットフォームを構築しています。 私たちは、より良い技術が現実世界の問題に対するより良い解決策につながることを強く信じている、無駄のない強固なチームです。
私たちのモットーは、まずやってみて、正しくやってみて、さらに良くやってみることです。
