A data architect builds the foundation of Wayfair's data ecosystem, partnering across engineering and business to ensure the timeliness, cleanliness and availability of the data behind Wayfair's reporting and data science. They are the experts on a given area of data, covering the range from how it is generated in an application to how to move, transform, and extract key business insights from it. They are comfortable working with application engineers to structure data in a way that facilitates reporting, as well as determining the appropriate location of data cleaning, transformation, and integrity checks. These data experts pair deep data modeling expertise with business understanding and project management to make answering key business questions as streamlined as possible.What You'll Do
What You Are
- Own an entire key area of data within Wayfair from generation to consumption, such as a trillion row clickstream dataset or product information from hundreds of suppliers
- Build, schedule, and manage data movement from application origin through batch and streaming systems to make it available for key business decisions
- Develop a robust, sustainable plan for the data area going forward, including projecting space requirements, procuring technology, and partnering with engineering on improvements to the data
- Ensure data products are aligned with the rapidly evolving needs of a multi-billion dollar business
- Provide consulting to engineering and data engineering organizations on best practices for designing applications to enable easy analytics; be an expert on large-scale data engineering
What You Have
- A true expert on big data, comfortable working with datasets of varying latencies and size and disparate platforms
- Excited about unlocking the valuable data hidden in inaccessible raw tables and logs
- Attentive to detail and with a relentless focus on accuracy
- Excited to collaborate with partners in business reporting and engineering to determine the source of truth of key business metrics
- Familiarity with distributed data storage systems and the tradeoffs inherent in each one
What we'd love to see (but isn't required)
- Hands on time with advanced SQL including writing complex, multi-stage transformations, user-defined functions, stored procedures, and tuning query performance. Experience with Hive or a distributed database system.
- Experience scheduling, structuring, and owning data transformation jobs that span multiple systems and have high requirements for volume handled, duration, or timing
- Prior projects working with optimizing storage and access of high volume heterogeneous data with distributed systems such as Hadoop, including familiarity with various data storage mediums and the tradeoffs of each
- Experience with agile development, source control systems, continuous integration and other standards of modern development
- Bachelors or Masters in Computer Science, Computer Engineering, Analytics, Mathematics, Statistics, Information Systems, Economics, Management or other quantitative discipline field with strong academic record.
- Ecommerce or retail analytics experience a strong plus
- Previous work with a distributed database system like Vertica or Redshift
- Previous experience with Hadoop and associated query systems like Presto or Hive
Wayfair is one of the world's largest online destinations for the home. Whether you work in our global headquarters in Boston or Berlin, or in our warehouses or offices throughout the world, we're reinventing the way people shop for their homes. Through our commitment to industry-leading technology and creative problem-solving, we are confident that Wayfair will be home to the most rewarding work of your career. If you're looking for rapid growth, constant learning, and dynamic challenges, then you'll find that amazing career opportunities are knocking.
No matter who you are, Wayfair is a place you can call home. We're a community of innovators, risk-takers, and trailblazers who celebrate our differences, and know that our unique perspectives make us stronger, smarter, and well-positioned for success. We value and rely on the collective voices of our employees, customers, community, and suppliers to help guide us as we build a better Wayfair - and world - for all. Every voice, every perspective matters. That's why we're proud to be an equal opportunity employer. We do not discriminate on the basis of race, color, ethnicity, ancestry, religion, sex, national origin, sexual orientation, age, citizenship status, marital status, disability, gender identity, gender expression, veteran status, or genetic information.
Associated topics: data architect, data integration, data manager, data management, database administrator, etl, erp, hbase, mongo database administrator, sql