mahabrain :brain: :books:
Overview
A web scrape of sacred-texts.com into an Obsidian Vault
Obsidian Vault Info
- Size: ~2.22 GB
- File Types: .md
- The vault in this repo (sacred_obsidian_vault) was scraped in March 2023 when the latest ISTA flash drive edition was 9.0.
Steps to Open in Obsidian
- Download
sacred_obsidian_vault
from this repo
- Do not run Scrapy the web-scraper script as this may be considered abuse and increase cost to run the sacred-texts website. Only download from the pre-scraped vault above.
- Download latest Obsidian.md version here
- Open Obsidian & choose
Open folder as vaultoption - Select the recently downloaded sacred_obsidian_vault
- Allow Obsidian to finish indexing the 120k+ files
- 🎉 You're good to go! Enjoy exploring!
Steps Used to Run Scraper (Only Use If Necessary)
Requirements
- Python 3.7+
- Works on Linux, Windows, macOS, BSD
Install
Run code below in project root directory in pyenv or venv
pip install -r requirements.txt
Run Scrapy
Execute the following to begin scraping sacred-texts.com into sacred_obsidian_vault top-level directory:
scrapy crawl books
:information_source: Note: This web scrape may take up to 1 hour to complete.
How to Install
- Download the ZIP or clone the repository
- Open the folder as a vault in Obsidian (File → Open Vault)
- Obsidian will prompt you to install required plugins
Stats
Stars
6
Forks
2
License
MIT
Last updated 35mo ago
Tags
booksobsidiansacred-textsscrascraperscrapyweb-scraper