Job Opportunities at the Internet Archive

Technical Lead at Archive-It.org

The Internet Archive, a 501(3)(c) non-profit with a mission to provide 'universal access to all knowledge,' is looking for a smart, collaborative and resourceful senior engineer to lead (and do) development of the next generation of the Archive-It service, a web based application first deployed in 2006.

Primary responsibilities would be to build and manage the technical team to extend the success of Archive-It, a web archiving service that librarians and archivists use to create collections of digital content, archiving billions of webpages, and then make them a searchable research tool for the world. Widely considered to be the market leader, our partner base has archived over five billion web pages and over 240 terabytes of data. http://archive-it.org

Working for Archive-It program's director, this position has technical responsibility to evolve this service to include archiving social network sites and html5-based sites while still being straightforward enough to be operated by hundreds of users with minimal technical skills. The ideal candidate will possess a desire to work collaboratively with a small internal team and a large, vocal and active user community; demonstrating independence, creativity, initiative and technological savvy, in addition to being a great programmer/architect.

The ideal candidate will have:

Experience building and motivating small tech teams to build web applications

5+ years work experience in php, python and/or java software development

Experience with Hadoop, specifically HBase and Pig

Experience developing web applications with accompanying database

Experience and/or interest in user interface design and information architecture

Strong familiarity with all aspects of web technology and protocols, including: HTTP, HTML, and Javascript

Experience with a variety of web applications, machine clusters, distributed systems, and high-volume data services.

Flexibility and a sense of humor

BS Computer Science, or equivalent work experience

Bonus points for:

Experience with web crawlers and/or applications designed to display [archived] web content (especially server-side apps)

Open source practices experience

Familiarity with Apache SOLR or similar facet-based search technologies

Experience with the building of or architecture of social media sites

Sound interesting and exciting, but you don't know much about web archiving and what it involves? Please sit-in on one of our informational webinars, held every other Tuesday at 11:30 a.m. to register: http://www.archive-it.org/contact-us

Archive.org's websites http://archive-it.org http://archive.org and http://openlibrary.org

Please send your resume and cover letter to kristine at archive dot org with the subject line "Tech Lead, Archive-It". The Archive thanks all applicants for their interest, but advises that only those selected for an interview will be contacted. No phone calls please!

We are an equal opportunity employer.

News [more]

Job Opportunities at the Internet Archive