Image Classification with Lazarus

Another fascinating option is to run the entire system as runtime virtualization with the help of a Jupyter notebook running on Ubuntu in the cloud on Google Colab or Colab.research container.

With the following report I show how to host and execute a deep learning project on a cloud. The cloud is hosted by google colab and enables working and testing in teams. Lazarus is also being built in colab and the deep learning networkis compiled and trained too in a Jupyter notebook.

Readable pdf version at:

https://www.academia.edu/53798878/maXbox_Starter87_Image_Classification_Lazarus

Lazarus is also being built in Colab and the deep learning network is compiled and trained too in a Jupiter notebook.

https://gitlab.ti.bfh.ch/knm4/python4delphi/-/blob/master/EKON24_SimpleImageClassificationCPU_2021.ipynb

The build of Free Pascal with Lazarus on a Ubuntu Linux is included, as can be seen under the following link:

https://github.com/maxkleiner/maXbox/blob/master/EKON24_SimpleImageClassificationCPU.ipynb

or an update with 64-bit

https://github.com/maxkleiner/python4delphi/blob/master/EKON24_SimpleImageClassificationCPU_2021.ipynb

Now the 16 Steps (extract):

https://colab.research.google.com/github/maxkleiner/python4delphi/blob/master/EKON24_SimpleImageClassificationCPU_2021.ipynb

!apt-get update

Ign:1https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64 InRelease Get:2https://cloud.r-project.org/bin/linux/ubuntu bionic-cran40/ InRelease [3,626 B] Ign:3https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64 InRelease Hit:4https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64 Release Hit:5https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64 Release Get:6http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] Get:7https://cloud.r-project.org/bin/linux/ubuntu bionic-cran40/ Packages [67.4 kB] Get:8http://ppa.launchpad.net/c2d4u.team/c2d4u4.0+/ubuntu bionic InRelease [15.9 kB] Hit:9http://archive.ubuntu.com/ubuntu bionic InRelease Get:11http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] Hit:13http://ppa.launchpad.net/cran/libgit2/ubuntu bionic InRelease Get:14http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] Hit:15http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease Get:16http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [581 kB] Hit:17http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic InRelease Get:18http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,428 kB] Get:19http://ppa.launchpad.net/c2d4u.team/c2d4u4.0+/ubuntu bionic/main Sources [1,802 kB] Get:20http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2,335 kB] Get:21http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2,202 kB] Get:22http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [613 kB] Get:23http://ppa.launchpad.net/c2d4u.team/c2d4u4.0+/ubuntu bionic/main amd64 Packages [922 kB] Get:24http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [2,770 kB] Fetched 13.0 MB in 4s (3,425 kB/s) Reading package lists... Done

!apt-get install fpc fpc-source lazarus git subversion

Reading package lists... Done Building dependency tree Reading state information... Done git is already the newest version (1:2.17.1-1ubuntu0.9).

!git clone https://github.com/joaopauloschuler/neural-api.git

Cloning into 'neural-api'... remote: Enumerating objects: 2372, done. remote: Counting objects: 100% (494/494), done. remote: Compressing objects: 100% (370/370), done. remote: Total 2372 (delta 340), reused 236 (delta 124), pack-reused 1878 Receiving objects: 100% (2372/2372), 4.58 MiB | 10.38 MiB/s, done. Resolving deltas: 100% (1585/1585), done.

!svn checkout https://svn.code.sf.net/p/lazarus-ccr/svn/components/multithreadprocs mtprocs

mtprocs/examples A mtprocs/examples/parallelloop1.lpr A mtprocs/examples/parallelloop_nested1.lpi A mtprocs/examples/parallelloop_nested1.lpr A mtprocs/examples/recursivemtp1.lpr A mtprocs/examples/simplemtp1.lpr A mtprocs/examples/parallelloop1.lpi A mtprocs/examples/recursivemtp1.lpi A mtprocs/examples/simplemtp1.lpi A mtprocs/examples/testmtp1.lpi A mtprocs/examples/testmtp1.lpr A mtprocs/Readme.txt A mtprocs/mtprocs.pas A mtprocs/mtpcpu.pas A mtprocs/multithreadprocslaz.lpk A mtprocs/mtputils.pas A mtprocs/multithreadprocslaz.pas Checked out revision 8093.

5. !lazbuild mtprocs/multithreadprocslaz.lpk

6. !ls -l neural-api/examples/SimpleImageClassifier/SimpleImageClassifier.lpi

-rw-r--r-- 1 root root 5694 Sep 23 08:37 neural-api/examples/SimpleImageClassifier/SimpleImageClassifier.lpi

7. !lazbuild neural-api/examples/SimpleImageClassifier/SimpleImageClassifier.lpi

Hint: (lazarus) [RunTool] /usr/bin/fpc "-iWTOTP" Hint: (lazarus) [RunTool] /usr/bin/fpc "-va" "compilertest.pas" TProject.DoLoadStateFile Statefile not found: /content/neural-api/bin/x86_64-linux/units/SimpleImageClassifier.compiled Hint: (lazarus) [RunTool] /usr/bin/fpc "-iWTOTP" "-Px86_64" "-Tlinux" Hint: (lazarus) [RunTool] /usr/bin/fpc "-va" "-Px86_64" "-Tlinux" "compilertest.pas" Hint: (11031) End of reading config file /etc/fpc.cfg Free Pascal Compiler version 3.0.4+dfsg-18ubuntu2 [2018/08/29] for x86_64 Copyright (c) 1993-2017 by Florian Klaempfl and others (1002) Target OS: Linux for x86-64 (3104) Compiling SimpleImageClassifier.lpr (3104) Compiling /content/neural-api/neural/neuralnetwork.pas (3104) Compiling /content/neural-api/neural/neuralvolume.pas

8. ls -l neural-api/bin/x86_64-linux/bin/SimpleImageClassifier

-rwxr-xr-x 1 root root 1951024 Sep 23 08:43neural-api/bin/x86_64-linux/bin/SimpleImageClassifier*

9. import os, import urllib.request

import os import urllib.request if not os.path.isfile('cifar-10-batches-bin/data_batch_1.bin'): print("Downloading CIFAR-10 Files") url = 'https://www.cs.toronto.edu/~kriz/cifar-10-binary.tar.gz' urllib.request.urlretrieve(url, './file.tar') Downloading CIFAR-10 Files
total 166080 -rw-r--r-- 1 root root 170052171 Sep 23 08:46 file.tar drwxr-xr-x 5 root root 4096 Sep 23 08:39mtprocs/ drwxr-xr-x 7 root root 4096 Sep 23 08:42neural-api/ drwxr-xr-x 1 root root 4096 Sep 16 13:40sample_data/

11. !tar -xvf ./file.tar

cifar-10-batches-bin/ cifar-10-batches-bin/data_batch_1.bin cifar-10-batches-bin/batches.meta.txt cifar-10-batches-bin/data_batch_3.bin cifar-10-batches-bin/data_batch_4.bin cifar-10-batches-bin/test_batch.bin cifar-10-batches-bin/readme.html cifar-10-batches-bin/data_batch_5.bin cifar-10-batches-bin/data_batch_2.bin
if not os.path.isfile('./data_batch_1.bin'): print("Copying files to current folder") !cp ./cifar-10-batches-bin/* ./
Copying files to current folder

13. Start Running

if os.path.isfile(‘./data_batch_1.bin’):

print(“RUNNING!”)

if os.path.isfile('./data_batch_1.bin'): print("RUNNING!")

!neural-api/bin/x86_64-linux/bin/SimpleImageClassifier

RUNNING! Creating Neural Network... Layers: 12 Neurons:331 Weights:162498 Sum: -19.536575 File name is: SimpleImageClassifier-64 Learning rate:0.001000 L2 decay:0.000010 Inertia:0.900000 Batch size:64 Step size:64 Staircase ephocs:10 Training images: 40000 Validation images: 10000 Test images: 10000 File name is: SimpleImageClassifier-64 Learning rate:0.001000 L2 decay:0.000010 Inertia:0.900000 Batch size:64 Step size:64 Staircase ephocs:10 Training images: 40000 Validation images: 10000 Test images: 10000 RUNNING! Creating Neural Network... Layers: 12 Neurons:331 Weights:162498 Sum: -19.536575
VALIDATION RECORD! Saving NN at SimpleImageClassifier-64.nn Epochs: 20 - Examples seen:800000 Validation Accuracy: 0.8077 Validation Error: 0.5409 Validation Loss: 0.5646 Total time: 69.72min Layer 0 Starting Testing. Epochs: 20 Examples seen:800000 Test Accuracy: 0.8013 Test Error: 0.5539 Test Loss: 0.5934 Total time: 70.75min
Epoch time: 2.2958 minutes. 50 epochs: 1.9132 hours.
Epochs: 20. Working time: 1.18 hours.
Learning rate set to: 0.00082
Layer 11 Max Output: 0.608 Min Output: 0.000 TNNetSoftMax 10,1,1 Times: 0.00s 0.00s Parent:10 Starting Testing. Epochs: 50 Examples seen:2000000 Test Accuracy: 0.8393 Test Error: 0.4457 Test Loss: 0.4874 Total time: 176.12min Epoch time: 2.3167 minutes. 50 epochs: 1.9306 hours. Epochs: 50. Working time: 2.94 hours. Finished.
14.from google.colab import files

!ls -l

-rw-r--r-- 1 root root 61 Sep 23 08:51 batches.meta.txt drwxr-xr-x 2 2156 1103 4096 Jun 4 2009 cifar-10-batches-bin -rw-r--r-- 1 root root 30730000 Sep 23 08:51 data_batch_1.bin -rw-r--r-- 1 root root 30730000 Sep 23 08:51 data_batch_2.bin -rw-r--r-- 1 root root 30730000 Sep 23 08:51 data_batch_3.bin -rw-r--r-- 1 root root 30730000 Sep 23 08:51 data_batch_4.bin -rw-r--r-- 1 root root 30730000 Sep 23 08:51 data_batch_5.bin -rw-r--r-- 1 root root 170052171 Sep 23 08:46 file.tar drwxr-xr-x 5 root root 4096 Sep 23 08:39 mtprocs drwxr-xr-x 7 root root 4096 Sep 23 08:42 neural-api -rw-r--r-- 1 root root 88 Sep 23 08:51 readme.html drwxr-xr-x 1 root root 4096 Sep 16 13:40 sample_data -rw-r--r-- 1 root root 3390 Sep 23 11:48 SimpleImageClassifier-64.csv -rw-r--r-- 1 root root 2349757 Sep 23 11:41 SimpleImageClassifier-64.nn -rw-r--r-- 1 root root 30730000 Sep 23 08:51 test_batch.bin
15.files.download('SimpleImageClassifier-64.nn') 16.files.download('SimpleImageClassifier-64.csv') FileNotFoundError: Cannot find file: SimpleImageClassifier.csv 16. 
files.download('SimpleImageClassifier-64.csv')

Summary of the 16 Steps:

# -*- coding: utf-8 -*- """
Kopie von EKON_SimpleImageClassificationCPU_2021.ipynb Automatically generated by Colaboratory. Original file is located at https://colab.research.google.com/drive/1clvG2uoMGo-_bfrJnxBJmpNTxjvnsMx9
 """
1. !apt-get update
2. !apt-get install fpc fpc-source lazarus git subversion
3. !git clone https://github.com/joaopauloschuler/neural-api.git
4. !svn checkout https://svn.code.sf.net/p/lazarus-ccr/svn/components/multithreadprocs mtprocs
5. !lazbuild mtprocs/multithreadprocslaz.lpk
6. !ls -l neural-api/examples/SimpleImageClassifier/SimpleImageClassifier.lpi
7. !lazbuild neural-api/examples/SimpleImageClassifier/SimpleImageClassifier.lpi 
9. ls -l neural-api/bin/x86_64-linux/bin/SimpleImageClassifier
10. import os import urllib.request
if not os.path.isfile('cifar-10-batches-bin/data_batch_1.bin'):
  print("Downloading CIFAR-10 Files")
url = 'https://www.cs.toronto.edu/~kriz/cifar-10-binary.tar.gz' urllib.request.urlretrieve(url, './file.tar')
 
11. ls -l 
!tar -xvf ./file.tar
 
12. if not os.path.isfile('./data_batch_1.bin'): 
 print("Copying files to current folder") !cp ./cifar-10-batches-bin/* ./ 
13. if os.path.isfile('./data_batch_1.bin'):
 print("RUNNING!")
 !neural-api/bin/x86_64-linux/bin/SimpleImageClassifier
14. from google.colab import files
!ls -l 
15. files.download('SimpleImageClassifier-66.nn')
16. files.download('SimpleImageClassifier-66.csv')

Originally published at http://softwareschule.code.blog on September 23, 2021.

person : 80.40134906768799
integrate image detector compute ends…

Colab with file structure