SwissText

Getting Started

  • Installation
    • Installation on a Linux server
    • Installation on MacOS
  • Usage
    • Running MongoDB
    • Running the frontend
    • Running the backend
  • Configuration options
    • Current ?best? pipeline configuration
      • Using default tools
      • Using extra tools
    • Tool dependencies

API

  • API Overview
    • swisstext.cmd
      • Configuration files
      • Link utilities
        • Dealing with links in a page
        • Dealing with search results
    • swisstext.cmd.scraping
      • st_scrape
        • dump_config
        • from_file
        • from_mongo
        • gen_seeds
      • Tool interfaces
      • Tool implementations
        • Deciders
        • Seed creators
        • Crawlers
        • Normalizers
        • Splitters
        • Sentence Filters
        • Link Filters
        • Language Detectors
        • Savers
      • Pipeline implementation
        • Configuration
        • Data structures
        • Queue
        • Pipeline
    • swisstext.cmd.searching
      • st_search
        • dump_config
        • from_file
        • from_mongo
      • Tool interfaces
      • Tool implementations
        • Savers
        • Searchers
      • Pipeline implementation
        • Configuration
        • Data structures
        • Search engine
    • swisstext.mongo
      • Installation
      • Collections
      • About the code
      • Abstract Definitions
        • Common structures and embedded documents
        • Seed collection
        • Sentences collection
        • URLs and Blacklist collections
        • Users collection
      • MongoEngine-ready classes
    • swisstext.alswiki
      • st_alswiki
        • download
        • parse
        • process
        • txt
      • Processing Alswiki dumps
      • Processing text files
  • TODOs

Other

  • Ideas
    • Sentence Filtering
    • URL Filtering
  • About this documentation
    • Generation
    • Deploying on github-pages
SwissText
  • Docs »
  • Welcome to SwissText’s documentation!
  • Edit on GitHub

Welcome to SwissText’s documentation!¶

Getting Started

  • Installation
    • Installation on a Linux server
    • Installation on MacOS
  • Usage
    • Running MongoDB
    • Running the frontend
    • Running the backend
  • Configuration options
    • Current ?best? pipeline configuration
    • Tool dependencies

API

  • API Overview
    • swisstext.cmd
    • swisstext.cmd.scraping
    • swisstext.cmd.searching
    • swisstext.mongo
    • swisstext.alswiki
  • TODOs

Other

  • Ideas
  • About this documentation

Indices and tables¶

  • Index

  • Module Index

  • Search Page

github_url

https://github.com/derlin/swisstext

Next

© Copyright 2018, Lucy Linder

Built with Sphinx using a theme provided by Read the Docs.