Group Importing

  • BeautifulSoup
  • Python
  • Scrapy
  • XPath
(5/14-6/14)
  • Backend
  • Prototyping

Summary

Created a CLI tool for importing members and messages from Yahoo groups.

Overview

To facilitate migration between Yahoo Groups and Kinsights group functionality for a key account, I created a Command Line Interface tool for a paginated approach to parsing and importing the member list in addition to parsing and importing the archived messages (for the last seven years.)

Many iterations were necessary and several heuristic methods were applied in order to ensure the cleanest import of the messages given different (undocumented) message schemas.

Additionally, I created the activation flow for the transition, partially by piecing together signup components from the existing codebase, partially by crafting new logic in the business layer.


anthony at bluxomelabs dot com