The only point of the CSV starting letter step seems to be to confirm the name of your group, in case you misremembered it.

Once you know it exactly, just reach for the regular archive.org search box — on the top right of the page, or in the centre on the front page (though not the Wayback Machine box that’s also on the front page) and get to the part where you type:

subject:”yahoo groups” myCoolGroupName

If your group is archived then that should get you to the unglamorously-named archive, e.g. the one I searched for ended up being in a collection called yahoo-groups-2016-09-24T16-36-18Z-81eae6. Then do the stuff it says above — hit ‘show all’ at the bottom of the download options, and grab the warc.gz file for your group. Then do the stuff above re: opening a WARC archive.

Make sure to install Beautifulsoup4 – `pip install beautifulsoup4`

In mfdl.py – Find the ‘find_direct_url’ function and replace it with this:

def find_direct_url(info_url):
rq = requests.get(info_url, headers=HTTP_HEADERS, timeout=TIMEOUT_T)
web_html = rq.text
soup = BeautifulSoup(web_html, ‘html.parser’)

# Find the download link
download_link = soup.find(‘a’, {‘class’: ‘input popsok’, ‘aria-label’: ‘Download file’})
if download_link is None:
return {“success”: 0}

direct_url = download_link[‘href’]

# Find the uploaded location
uploaded_from_tag = soup.find(‘p’, text=re.compile(‘This file was uploaded from ‘))
if uploaded_from_tag is None:
return {“url”: direct_url, “location”: “Unknown”, “success”: 1}

uploaded_from = uploaded_from_tag.text
location = uploaded_from.split(” on “)[0].replace(“This file was uploaded from “, “”)

return {“url”: direct_url, “location”: location, “success”: 1}

This uses BS4 to parse the webpage and look for the href download link we want, avoiding the manual way of just searching for the exact download_link_prefix. I would make a commit or merge, but it seems the 2 maintainers aren’t active on there anymore. Hope this helps anyone using the tool! Everything else in the tutorial (at least for downloading folders) should

Thank you.

I’d be interested in this info as well! The group I’m looking for is open and its metadata is there, but it’s not in any downloadable archive. 🙁

1. Simply take this url:
https://archive.org/search?query=subject%3A%22yahoo%20groups%22%20handle
and replace [handle] with the exact name of their former group, as found in the group’s old Yahoo web address. If the official Yahoo Group was located at yahoo.com/groups/abrahamlincolnofficial or groups.yahoo.com/neo/groups/abrahamlincolnofficial, then the group handle was “abrahamlincolnofficial”. Former group owners and admins would hopefully remember the handle.

2. If there is a search result with the Yahoo logo, then click on the result. If there is no result and you are certain of the handle,

3. Click on “Web Archive GZ” to download the compressed archive of your group.

4. Choose decompression tools to extract and display the archive.

I will join the tech team that seems to be working on this.

https://yahoogroups.dreamwidth.org/profile