Skip to content

spraakbanken/resource-sida-omvarlden

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

resource-sida-omvarlden

Programs to scrape and prepare Sidas OmVärlden

All programs depend on rust.

MIT licensed

Maturity badge - level 1

CI(check) CI(scheduled) CI(test)

omvarlden-crawler

Program to scrape Sidas OmVärlden.

Install

Simply run:

cargo build --release

The executable is then located in ./target/release/omvarlden-crawler.

Usage

Either run the executable from your computer or copy to a linux server of your choice.

Suggestion is to use nohup like this:

nohup ./omvarlden-crawler > stdout.txt 2> stderr.json &

MSRV Policy

The MSRV (Minimum Supported Rust Version) is fixed for a given minor (1.x) version. However it can be increased when bumping minor versions, i.e. going from 1.0 to 1.1 allows us to increase the MSRV. Users unable to increase their Rust version can use an older minor version instead. Below is a list of resource-sida-omvarlden versions and their MSRV:

  • v0.1: Rust 1.74.

Note however that resource-sida- omvarlden also has dependencies, which might have different MSRV policies. We try to stick to the above policy when updating dependencies, but this is not always possible.

About

Programs to scrape and prepare Sidas OmVärlden

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages