Hello! Welcome to this repository! This project is aimed for helping people learn new languages using quotes. It currently is powered by a Python web crawler which fetches data from WikiQuotes and adds it to the DB. We're looking for help in order to expand the number of languages supported by the app (currently, we're able to fetch only quotes in French), possibly implementing integrations for SRS systems.
This idea was born from my (@viniciusarre)[https://github.com/viniciusarre] idea of language learning as well as when I was reading about (natural language acquisition)[https://www.sk.com.br/sk-krash-english.html] by Stephen Krashen. Therefore, the objective of the project is create a medium that has concise and approachable content for the new learners to use and use. I personally find quotes quite interesting for that.
This is a Python implementation for fetching data from wikiquote as well as stashing it by its author and language.
This was my first project using Python, I have been improving it as I learn more about this amazing programming language, and, if you'd like to help or suggest any improvements, I strongly encourage you and any help would be appreciated!
Using Python 3:
Creage a venv folder by running
virtualenv venv
Once it's done, activate the environment:
source venv/bin/activate
Now install the dependencies in requirements.txt by running
pip install -r requirements.txt
Then run the project with
python script.py
The script tries to connect to a MongoDB instance at port 27017 on localhost. You can do this easily using docker with the following command:
docker run -it -p 27017:27017 --name mongodb -d mongo
This runs a new container with the last version of the mongo
image and forwards the local port 27017 to the port 27017 in the container instance with name mongodb
.
Using Python 3, to run test:
python -m unittest tests/Test_crawler.py