searchanddisplace-ingest/README.md

Search and Displace Ingest

🌀 Server Requirements:

• php7.4 [https://www.php.net] LICENSE
• apache [https://httpd.apache.org] LICENSE
• python 3.8 [https://www.python.org/] LICENSE
• composer [https://getcomposer.org/] LICENSE

⚡ Build with:

• Laravel Framework ^6.2

🚀 Installation

Ubuntu Packages

# LibreOffice
apt-get install python-software-properties
apt-add-repository ppa:libreoffice/ppa
apt-get update
apt-get install libreoffice

# Python
apt-get update
apt-get install software-properies-common
add-apt-repository ppa:deadsnakes/ppa
apt-get install supervisor python3.8 python3.8-dev

# Redis
apt-get install redis-server

# PDF Convertor
apt-get install libpoppler-cpp-dev
apt-get install poppler-utils

# Tesseract OCR
add-apt-repository ppa:alex-p/tesseract-ocr-devel
apt-get update
apt-get install tesseract-ocr

# Unpaper
apt-get install unpaper

# DOCX to PDF Convertor
apt-get install unoconv

Libraries Packages

# Pip
curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py
python get-pip.py
rm -rf get-pip.py
pip install --upgrade pip

# Pdftotext
pip install pdftotext

# Supervisor
pip install supervisor
systemctl enable supervisor
mkdir /var/log/amqp
mkdir /var/log/queue

# Deskew
cd DESKEW_INSTALLATION_DIRECTORY
cd Bin
./deskew INPUT OUTPUT

# Dewarp
pip3 install opencv-python

cd DEWARP_INSTALLATION_DIRECTORY
pip3 install -r requirements.txt

Install app

# Generate environment file
cp .env.example .env

# Install backend packages
composer install

# Generate app key
php artisan key:generate

# Change the value for the QUEUE_CONNECTION to redis, if it is not set already

# Deploy supervisor
php artisan queue:deploy-supervisor

supervisorctl start all

Search and Displace Core Setup

• Install the Search and Displace Core app, found here https://git.law/newroco/searchanddisplace-core
• Get the URL of the Search and Displace Core app and add it to the WEBHOOK_CORE_URL variable in .env
• Add in .env the WEBHOOK_CORE_SECRET value which needs to be the same value as the WEBHOOK_CLIENT_SECRET in the Search and Displace Core app's .env file

PHP Packages

• cebe/markdown LICENSE
• fideloper/proxy LICENSE
• laravel/framework LICENSE
• laravel/tinker LICENSE
• league/html-to-markdown LICENSE
• phpoffice/phpword LICENSE
• predis/predis LICENSE
• spatie/laravel-webhook-server LICENSE
• spatie/pdf-to-text LICENSE
• thiagoalessio/tesseract_ocr LICENSE