{"id":174,"date":"2020-02-21T18:52:03","date_gmt":"2020-02-21T18:52:03","guid":{"rendered":"https:\/\/blog.mozilla.org\/data\/?p=174"},"modified":"2020-03-30T18:55:45","modified_gmt":"2020-03-30T18:55:45","slug":"this-week-in-glean-a-distributed-team-echoes-distributed-workflow","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/data\/2020\/02\/21\/this-week-in-glean-a-distributed-team-echoes-distributed-workflow\/","title":{"rendered":"This Week in Glean: A Distributed Team Echoes Distributed Workflow"},"content":{"rendered":"

(\u201cThis Week in Glean\u201d is a series of blog posts that the Glean Team at Mozilla is using to try to communicate better about our work. They could be release notes, documentation, hopes, dreams, or whatever: so long as it is inspired by Glean. You can find an index of all TWiG posts online<\/a>.)<\/em><\/p>\n

I was recently struck by a realization that the position of our data org\u2019s team members around the globe mimics the path that data flows through the Glean Ecosystem.<\/p>\n

Glean Data takes this five-fold path (corresponding to five teams):<\/p>\n

    \n
  1. Data is collected in a client using the Glean SDK (Glean Team)<\/li>\n
  2. Data is transmitted to the Structured Ingestion pipeline (Data Platform)<\/li>\n
  3. Data is stored and maintained in our infrastructure (Data Operations)<\/li>\n
  4. Data is presented in our tools (Data Tools)<\/li>\n
  5. Data is analyzed and reported on (Data Science)<\/li>\n<\/ol>\n

    The geographical midpoint of the Glean Team is about halfway across the north atlantic. For Data Platform it\u2019s on the continental US, anchored by three members in the midwestern US. Data Ops is further West still, with four members in the Pacific timezone and no Europeans. Data Tools breaks the trend by being a bit further East, with fewer westcoasters. Data Science (for Firefox) is centred farther west still, with only two members East of the Rocky Mountains.<\/p>\n

    Or, graphically:<\/p>\n

    \"gleanEcosystemTeamCentres\"
    (approximate) Team Geocentres<\/figcaption><\/figure>\n

    Given the rotation of the Earth, the sun rises first on the Glean Team and the data collected by the Glean SDK. Then the data and the sun move West to the Data Platform where it is ingested. Data Tools gets the data from the Platform as morning breaks over Detroit. Data Operations keeps it all running from the midwest. And finally, the West Coast Centre of Firefox Data Science Excellence greets the data from a mountaintop, to try and make sense of it all.<\/p>\n

    (( Lying orthogonal to the data organization is the secret Sixth Glean Data \u201cTeam\u201d: Data Stewardship<\/a>. They ensure all Glean Data is collected in accordance with Mozilla\u2019s Privacy Promise<\/a>. The sun never sets on the Stewardship\u2019s global coverage, and it\u2019s a volunteer effort supplied from eight teams (and growing!), so I\u2019ve omitted them from this narrative. ))<\/p>\n

    Bad metaphors about sunlight aside, I wonder whether this is random or whether this is some sort of emergent behaviour.<\/p>\n

    Conway\u2019s Law<\/a> suggests that our system architecture will tend to reflect our orgchart (well, the law is a bit more explicit about \u201ccommunication structure\u201d independent of organizational structure, but in the data org\u2019s case they\u2019re pretty close). Maybe this is a specific example of that: data architecture as a reflection of orgchart geography.<\/p>\n

    Or perhaps five dots on a globe that are only mostly in some order is too weak of a coincidence to even bear thinking about? Nah, where\u2019s the blog post in that thinking\u2026<\/p>\n

    If it\u2019s emergent, it then becomes interesting to consider the \u201cchicken and egg\u201d point of view: did the organization beget the system or the system beget the organization? When I joined Mozilla some of these teams didn\u2019t exist. Some of them only kinda existed within other parts of the company. So is the situation we\u2019re in today a formalization by us of a structure that mirrors the system we\u2019re building, or did we build the system in this way because of the structure we already had?<\/p>\n

    mindblown.gif<\/a><\/p>\n

    :chutten<\/p>\n

    (( This is a syndicated copy of the original post<\/a>. ))<\/p>\n","protected":false},"excerpt":{"rendered":"

    (\u201cThis Week in Glean\u201d is a series of blog posts that the Glean Team at Mozilla is using to try to communicate better about our work. They could be release … Read more<\/a><\/p>\n","protected":false},"author":1437,"featured_media":175,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[315988,448297],"tags":[30,448297],"coauthors":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/posts\/174"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/users\/1437"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/comments?post=174"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/posts\/174\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/media\/175"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/media?parent=174"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/categories?post=174"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/tags?post=174"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/blog.mozilla.org\/data\/wp-json\/wp\/v2\/coauthors?post=174"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}