Intellectual property of Fraunhofer IAIS (closed source)
The face detection mining service allows to detect one or more faces to be found in images and videos.
Input: Image file or video file. You can specify which frames are to be processed for a video.
Output: A set of detected faces will be returned for the image or each processed frame. For each detected face an axially parallel bounding box and a vectorized representation of the face (embedding) are returned. In addition, an automatically generated ID is assigned to each detected face to allow the unambiguous identification of all detected faces in one media file.
The service utilizes the Dlib toolkit for machine learning. Image processing in Dlib is based on HoG (Histograms of Oriented Gradients for Human Detection). Dlib implements a front face detector which uses a pretrained network for the recognition of human faces. The network has been trained on 3 million faces derived from a number of datasets: The face scrub dataset, the VGG dataset, and a large number of images Davis King, the creator of Dlib, scraped from the internet.
The mining service is also able to recognize faces from a previously trained gallery of people's faces. If a detected face matches a previously trained one, the mining result contains a label (e.g. Name or URI) and a score representing the confidence of the assignment.
The mining service is (1) lawful, as it respects all applicable laws and regulations (e. g. software licenses of used open source components), especially it is GDPR-compliant, (2) ethical, as it pursues the ethical goal of making information from documents easily accessible in digital form to the documents' owner, (3) robust, from a technical perspective, especially as it is deployed in a "ready-to-use" Docker container, to make processing documents as simple as possible.
The mining service allows the user to extract textual context from images and video files. The software itself is GDPR compliant. Images and video files are processed within a Docker container and all data remains on the user's local computer. However, the user must ensure that he has the authority to store and process the file, for example if it contains personal data or other sensitive, GDPR-relevant information.