The research team deals with applied research and experimental development in the field of machine and deep learning for solving problems in industrial productions such as:
- extraction of properties from visual and other data,
- data segmentation and clustering,
- detection, localization and classification of objects,
- automation and robotization of production processes.
Key words
Automation – Robotics – Machine Vision – Artificial intelligence – Deep Learning – Image Processing – Signal Analysis
Research Team members
- doc. Ing. Petr Doležel, Ph.D.
- doc. Ing. Jan Mareš, Ph.D.
- doc. Ing. Dušan Kopecký, Ph.D.
- Ing. Daniel Honc, Ph.D.
- Ing. Dominik Štursa
Projects being solved
| 2018 – 2022 | Cooperation in Applied Research between the University of Pardubice and companies, in the Field of Positioning, Detection and Simulation Technology for Transport Systems (PosiTrans). MEYS CR, programme OPVVV |
| 2020 – 2022 | Artificial intelligence enabled smart contactless technology development for smart fencing. MEYS CR, programme INTER-ACTION |
| 2020 – 2021 | Universal Programmable Image Sensor. TA CR, programme GAMA |
| 2020 – 2021 | Examination of taste during the COVID epidemic using telemedicine. TA CR, programme GAMA |
| 2018 - 2020 | Technology development for intelligent traffic flow. MIT, programme Applications |
| 2020 – 2022 | Research and development of intelligent system for control. MIT, programme Applications |
Selected publications
| Dolezel P., Holik F., Merta J., Stursa D. Optimization of a Depiction Procedure for an Artificial Intelligence-Based Network Protection System Using a Genetic Algorithm. Applied Sciences. 2021; 11(5):2012 |
| Rozinek O., Mareš J. The Duality of Similarity and Metric Spaces. Applied Sciences. 2021; 11(4):1910 |
|
Stursa, D., Honc, D., Dolezel, P. Development of image procesing system for person detection, MM Science Journal, pp. 4000-4006, 2020. |
|
Skrabanek, P., Dolezel, P., Nemec, Z., Stursa, D. Person Detection for an Orthogonally Placed Monocular Camera, Journal of Advanced Transportation, 2020. |
|
Vrba, J., Mareš, J. Introduction to extreme seeking entropy, Entropy, 22 (1), p. 93, 2020. |
|
Krbcova, Z., Kukal, J., Mares, J., Habartova, L., Setnicka, V. Variational approach to cancerous tissue identification from in vivo Raman spectra, Biomedical Signal Processing and Control, 49, pp. 520-527, 2019. |
|
Dušek, F., Honc, D. Desired Terminal State Concept in Model Predictive Control: A Case Study, Journal of Control Science and Engineering, 2019. |
|
Abraham, A., Pappa, N., Honc, D., Sharma, R. Reduced order modelling and predictive control of multivariable nonlinear process, Sadhana - Academy Proceedings in Engineering Sciences, 43 (3), 2018. |
|
Dolezel, P., Heckenbergerova, J. Computationally simple neural network approach to determine piecewise-linear dynamical model, Neural Network World, 27 (4), pp. 351-371, 2017. |
|
Mareš, J., Kukal, J., Hrnčiřík, P., Náhlík, J. Process state classification of fed-batch fermentation based on process variables analysis, Biochemical Engineering Journal, 112, pp. 178-185, 2016. |
Research activities in detail
1. Observation of moving objects and people
Passenger observation and counting in transport vehicles is one of the basic functions of the monitoring systems in public transport. It is used for surveillance systems, prediction of the number of passengers, traffic planning and for vehicle utilization monitoring. Monitoring systems must not only be accurate but also inexpensive. Based on these requirements, the research team is developing a monitoring system for observing moving objects and people using an RGB camera sensor located vertically downwards above the scanned area. The sensor placed in this way eliminates the possibility of overlapping objects of interest and at the same time does not allow the identification of individuals when scanning people. This simplifies the legislative process of putting the monitoring system into operation.
The monitoring system is developed on the basis of classical image processing methods (histograms of oriented gradients, edge detection, detection of binary area patterns,…) in combination with a sliding window and a group of decision algorithms like supporting vector method, multilayer perceptron and convolutional neural network. The research team is using a unique approach of a fully convolutional neural network transforming the input from the camera sensor without any intermediate steps into a schematic image formed by gradient spheres and background. The gradient spheres define the position of objects of interest in the monitored space. The research team is currently working on variants of the fully convolutional neural network U-Net in order to find the optimal topology in terms of accuracy of the provided solution and computational complexity.
Applications of this approach are already not only being developed for the observation of people in public spaces, public transport vehicles, but also for safety applications in the protection of areas of interest from drones or unmanned aerial vehicles.
2. Classification and localization of objects for automatic manipulation in industrial production
The "Pick and Place" problem is one of the key tasks to solve in the process of modernization of industrial production with automation and advanced robotics. The goal is to grasp the object by a robot and transfer it to a designated position. In combination with a complex object shape which has to be manipulated this is a non-trivial task in the case of an unknown position and orientation. In practice it is solved only for specific conditions in a particular production line. As part of the solution, it is necessary to choose an appropriate robotic arm with a specific gripper suitable for object holding. Then it is necessary to determine the positions and orientations of objects by using a suitable computer vision system and to select one object to pick together with its optimal grip point. The last step is to plan the movement of the robotic arm in order to elevate the object and place it into defined position. Currently, the research team is dealing with an effective way of classification, detection and localization of objects of interest in 3D space using a classical method such as ICP algorithm, but also using fully convolutional neural networks and various types of sensors (RGB, IR, ToF, laser).
