COLLECTED BY
Organization:
Internet Archive
Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.
The Wayback Machine - https://web.archive.org/web/20210123224857/https://github.com/internetarchive/openlibrary/blob/master/setup.py
Permalink
47 lines (42 sloc)
802 Bytes
import glob
import os
from setuptools import setup , find_packages
from stat import ST_MODE , S_IEXEC , S_ISDIR
from Cython .Build import cythonize
def executable (path ):
st = os .stat (path )[ST_MODE ]
return (st & S_IEXEC ) and not S_ISDIR (st )
dependencies = """
Babel
PIL
argparse
beautifulsoup4
DBUtils
genshi
gunicorn
iptools
lxml
psycopg2
pymarc
pytest
python-memcached
pyyaml
simplejson
supervisor
web.py==0.33
pystatsd
eventer
Pygments
OL-GeoIP
mockcache
"""
setup (
name = 'openlibrary' ,
version = '2.0' ,
description = 'Open Library' ,
packages = find_packages (exclude = ["ez_setup" ]),
scripts = filter (executable , glob .glob ('scripts/*' )),
install_requires = dependencies .split (),
# Used to make solrbuilder faster
ext_modules = cythonize ("openlibrary/solr/update_work.py" )
)
You canβt perform that action at this time.
You signed in with another tab or window. Reload to refresh your session.
You signed out in another tab or window. Reload to refresh your session.