Lead Software Engineer - Data Platform (Python, Cloud, Big Data)
Lead Software Engineer - Data Platform (Python, Cloud, Big Data)
Company & Department Context
The Financial Times is one of the world’s leading business news organisations, recognised internationally for its authority, integrity and accuracy. The FT has a record paying readership of one million, three-quarters of which are digital subscriptions. It is part of Nikkei Inc., which provides a broad range of information, news and services for the global business community.
We have offices in more than 35 cities, including London, New York, Hong Kong, Beijing, Manila, Sofia, San Francisco and Tokyo. Join us and find an inclusive and fast-paced environment with unique opportunities to support every step of your career.
Learn more about the FT, including announcements and career opportunities, at aboutus.ft.com
This is an exciting opportunity for an engineer to join the FT Core group as part of the Product & Technology organisation within FT.
FT Core brings together key digital assets like:
Content and Metadata - enabling content publishing, discoverability and targeting
Membership - powering a seamless subscription/payments/access and the whole newspaper distribution customer journeys
Data Platform - enabling storing, processing and getting insights from readership data
You will have the autonomy to select the tools and technologies you need to build and operate services responsible for FT brand critical capabilities. Someone who is comfortable with the ever changing technical landscape and is keen to contribute to the company’s processes and broader know-how would thrive in this role.
Working in the Data Platform team you will be responsible for delivering innovative technical solutions as you build and operate world class platforms to grow the Financial Times strategic business models. To help you understand in more details the Financial Times’ Data Platform team’s goals and projects take a look at this article.
The Tech Stack
We often use these, it's not an exhaustive list but gives you a taste of what our technology stack and tools look like:
Workflow orchestration tools like Airflow, Luigi or Oozie
AWS: ECS/EKS, Kinesis/MSK (Kafka), Redshift
Streaming technologies like Kafka, Spark or Flink
Distributed SQL Engines like Presto, Athena or Impala
Graphite, Grafana, Splunk
The hiring process
We understand that tech interviews are often stressful for no good reason, so we designed our interview process to be rigorous but friendly. We have tech tests requiring minimal code writing and algorithms understanding, a friendly system design exercise and a set of questions to encourage you to tell us about your strengths and what makes you happy at work.
We're committed to equality and diversity in the tech industry, so we'll be especially happy to see applications from under-represented backgrounds. We encourage this by considering flexible working hours as well as tuning the hiring process to promote diversity.
This role will be right for you if you are happy to:
Work directly with senior stakeholders and product owners to fully shape solutions from inception to deployment and beyond
Lead a team of engineers in an agile delivery team
Development of high quality data solutions within Financial Times’ Data Platform
Design and implement low maintenance, well monitored, secure and scalable solutions to customer problems
Design, build and operate solutions, from cradle to grave, which meet both functional and non-functional KPIs
Understand and play an active part in designing the architecture, tooling and release cycle processes used by the engineering teams across Product & Technology
Contribute to company-wide processes, frameworks and guidelines
Develop an in-depth understanding of FT’s underlying data and data flow, data structures.
Develop a close relationship with our customers and provide operational support
Good command of written and spoken English
Experience in the role of technical lead of a multi-disciplined group of engineers in an agile delivery team
Highly proficient in the programming languages relevant to the Data domain at the FT - Python and Java
Extensive experience designing, programming, and implementing large information systems
Experience working with data sources of varying volumes, variety and velocity
Good understanding of the principles and trade-offs of a microservices architecture
Good working experience of at least one cloud infrastructure, ideally AWS
Comfortable working in a Linux environment
Being able to establish and be promoter of good coding and engineering practices
Being able to architect and lead the development of solutions based on functional requirements
Being able to mentor other team members
Being able to make fast and informed decisions
Being an active member of the broader technology community with an understanding and passion of the current leading trends
Being a leader with solid organisational and time management skills
Experience working within an environment where operational support and monitoring of code and systems is part of the culture (DevOps)
Experience designing and developing RESTful APIs
Ability to accurately monitor and analyse system performance using tools like Grafana
Experience productionizing Machine learning algorithms or Data science models
Experience with streaming applications such as Kafka streams, Spark streaming
Experience in working with ETL frameworks (job orchestration tools) such as Airflow or Luigi
Experience in modern database technologies (AWS/cloud-based/in-memory etc.), scripting languages, big data technologies
Knowledge of optimisation techniques like indexing/performance tuning on both relational and columnar databases
What is in it for you? Our Benefits.
Our benefits vary depending on location, but we are committed to providing best in class perks across all our offices as well as an inclusive environment to develop your career. Examples of our benefits include; generous annual leave allowances, flexible working, medical cover, enhanced maternity & paternity packages and subsidised gym memberships. Full details of our benefits can be found here.
At the FT, we are committed to providing an inclusive working environment for all. We are an equal opportunities employer that seeks to recruit and appoint the best talent regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief. We also promote flexible working and will consider specific requests around flexibility for all roles where it can be accommodated. We aim to treat all employees in a fair and consistent manner, promote good working relationships to encourage high standards of conduct and performance within a work environment free from harassment, bullying and discrimination. Please let us know if you require any adjustments as part of the application process or to enable you to attend an interview. If you would like to discuss your requirements, or have any questions, please contact a member of our HR team who will be happy to help.