Face recognition using Python and OpenCV

Just playing around with deep learning with the folks in the office. It was retrieved 7785 face encodings from the user’s database, performed face detection, encoding and calculating the least Euclidean distance between face encodings, then returning the username of the detected face.

That script was developed with Python 3.6, OpenCV, and the face_recognition wrapper.

The code is available at: https://github.com/progerjkd/face_recognition

The TODO list includes receive the URL of photos via API and improves the affinity of detection.

Installing Python into your home directory

Sometimes we may need a newer Python version than the one installed into our station, and the Linux distribution does not provide the last release in its repositories. We could get rid the installed Python packages and make a new installation from the source code. However, various OS applications make use of the default Python version installed, thus there is a risk of breaking some applications or services of the system in the case of overriding the Python provided by the package management system used, yum or apt, for example.

Thus, we may install Python into the local user directory, and let the default Python installation intact.

Another reason to do this is to have multiple Python environments when developing or debugging old Python scripts.

The following commands were tested into an Ubuntu 16.04 amd64 docker container.

Install prerequisites for downloading and compiling Python from source:

# apt install xz-utils wget gcc make \
  libssl-dev libffi-dev zlib1g-dev

If you are running CentOS 7,  install the following packages:

# yum groupinstall -y "development tools"

# yum install -y \
  libffi-devel \
  zlib-devel \
  bzip2-devel \
  openssl-devel \
  ncurses-devel \
  sqlite-devel \
  readline-devel \
  tk-devel \
  gdbm-devel \
  db4-devel \
  libpcap-devel \
  xz-devel \
  expat-devel

Create a folder for the new Python installation, download, and extract the source code. In this example, I used the hidden directory $HOME/.python.

mkdir $HOME/.python
cd $HOME/.python
wget https://www.python.org/ftp/python/3.7.0/Python-3.7.0.tar.xz
tar Jxvf Python-3.7.0.tar.xz
cd Python-3.7.0

Compile and install Python.

./configure --prefix=$HOME/.python --enable-optimizations
make
make install

Next, we need to edit $HOME/.profile , and $HOME/.bashrc files to add the Python’s bin directory to $PATH.

export PATH="$HOME/.python/bin:$PATH"
export PYTHONPATH="$HOME/.python"

Then we can reload the current session by doing:

source $HOME/.profile

Now we have multiple python installations on our system. If we type ‘python’ and press TAB twice we can see:

roger@9e65d2dd5598:~$ python
python python2.7 python3-config python3.5m python3.7-config python3.7m-config
python2 python3 python3.5 python3.7 python3.7m python3m

So, to run the new python REPL, we must enter:

roger@9e65d2dd5598:~$ python3.7
Python 3.7.0 (default, Sep 26 2018, 22:06:04)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>

Pip also is referred by its version:

roger@9e65d2dd5598:~$ pip3.7

Usage:
pip3.7 <command> [options]

When developing executable python scripts for this environment, the bash shebang used must be like:

#!/usr/bin/env python3.7

Delete the Python source code and compilation directory:

rm -fr $HOME/.python/Python-3.7.0*

 

This article is adapted from the solution presented in http://thelazylog.com/install-python-as-local-user-on-linux/.

“ERROR: could not find an available, non-overlapping IPv4 address pool among the defaults to assign to the network” – docker-compose and bridge config problem.

Recently I had an error while running docker-compose.

$ docker-compose up -d --build
Creating network "courseenvironments_default" with the default driver
ERROR: could not find an available, non-overlapping IPv4 address pool among the defaults to assign to the network

After googled a bit, I tried to remove unused docker networks with:

$ docker network prune

But, no success.

After inspecting my /etc/network/interfaces file, I decided to change my network configuration:

# interfaces(5) file used by ifup(8) and ifdown(8)
auto lo
iface lo inet loopback

auto br0
iface br0 inet dhcp
             bridge_ports eth0
             bridge_stp off
             bridge_fd 0
             post-up vconfig add br0 100
             post-up ifconfig br0.100 200.200.200.200/23
             post-up route add default gw 200.200.200.1
             post-up route del default gw 10.1.1.1
             post-up route add -net 10.0.0.0/8 gw 10.1.1.1
             post-up route add -net 192.168.0.0/16 gw 10.1.1.1
             post-up route add -net 172.16.0.0/12 gw 10.1.1.1
             post-down vconfig rem br0.100

I used to use this bridge in my old VirtualBox and GNS3 configurations; thus I removed it and used my VLAN tagged config directly into eth0 interface:

auto eth0
iface eth0 inet dhcp
            post-up vconfig add eth0 100
            post-up ifconfig eth0.100 200.200.200.200/23
            post-up route add default gw 200.200.200.1
            post-up route del default gw 10.1.1.1
            post-up route add -net 10.0.0.0/8 gw 10.1.1.1
            post-up route add -net 192.168.0.0/16 gw 10.1.1.1
            post-up route add -net 172.16.0.0/12 gw 10.1.1.1
            post-down vconfig rem eth0.100

After stopping the networking and applying the new conf, docker-compose could create the new network, and the build process finished without errors:

# ifdown br0
# vconfig rem br0.100
# brctl delbr br0
# service networking restart

$ docker-compose up -d --build
Building jenkinsBuilding jenkins
Step 1/8 : FROM jenkins:latest
 ---> cd14cecfdb3a
Step 2/8 : MAINTAINER Ernest Mueller <ernestmueller@theagileadmin.com>
 ---> Using cache
 ---> bc8067b1e3b2
Step 3/8 : USER root
 ---> Using cache
 ---> b0de05eb295c
Step 4/8 : RUN     apt-get update &&     apt-get install -y build-essential &&     apt-get clean &&     rm -rf /var/lib/apt/lists/*

Step 1/8 : FROM jenkins:latest
 ---> cd14cecfdb3a
Step 2/8 : MAINTAINER Ernest Mueller <ernestmueller@theagileadmin.com>
 ---> Using cache
 ---> bc8067b1e3b2
Step 3/8 : USER root
 ---> Using cache
 ---> b0de05eb295c
Step 4/8 : RUN     apt-get update &&     apt-get install -y build-essential &&     apt-get clean &&     rm -rf /var/lib/apt/lists/*