| id |
caadria2022_220 |
| authors |
Hsiao, Chi-Fu, Lee, Ching-Han, Chen, Chun-Yen, Fang, Yu-Cyuan and Chang, Teng-Wen |
| year |
2022 |
| title |
Training a Vision-Based Autonomous Robot From Material Bending Analysis to Deformation Variables Predictions With an XR Approach |
| doi |
https://doi.org/10.52842/conf.caadria.2022.2.201
|
| source |
Jeroen van Ameijde, Nicole Gardner, Kyung Hoon Hyun, Dan Luo, Urvi Sheth (eds.), POST-CARBON - Proceedings of the 27th CAADRIA Conference, Sydney, 9-15 April 2022, pp. 201-210 |
| summary |
This paper proposes a "Human Aided Hand-Eye System (HAHES)" to aid the autonomous robot for "Digital Twin Model (DTM)" sampling and correction. HAHES combining the eye-to hand and eye-in hand relationship to build an online DTM datasets. Users can download data and inspect DTM by "Human Wearable XR Device (HWD)", then continuous updating DTM by back testing the probing depth, and the overlap between physics and virtual. This paper focus on flexible linear material as experiment subject, then compares several data augmentation approaches: from 2D OpenCV homogeneous transformation, autonomous robot arm nodes depth probes, to overlap judgement by HWD. Then we train an additive regression model with back-testing DTM datasets and use the gradient boosting algorithm to inference an approximate 3D coordinate datasets with 2D OpenCV datasets to shorten the elapsed time. After all, this paper proposes a flexible mechanism to train a vision-based autonomous robot by combing different hand-eye relationship, HWD posture, and DTM in a recursive workflow for further researchers. |
| keywords |
Digital Twin Model, Hand-Eye Relationship, Human Wearable XR Device, Homogeneous Transformation, Gradient Boosting, SDG 4, SDG 9 |
| series |
CAADRIA |
| email |
|
| full text |
 file.pdf (1,179,659 bytes) |
| references |
Content-type: text/plain
|
Batliner, C., Newsum, Jake, M & Rehm, M.C. (2015)
 Live: Real-Time Platform for Robot Design Interfaces
, 33rd Education and Research Computer Aided Architectural Design Europe, eCAADe 2015 (pp.277-286). Education and Research Computer Aided Architectural Design Europe (eCAADe)
|
|
|
|
|
Chang, T., Hsiao, C., Chen, C., Huang, H., Datta, S. & Mao, W. (2020)
Fabricating Behavior Sensor Computing Approach for Coexisting Design Environment
, Sensors and Materials, 32(7), 2409-2417. https://doi.org/https://doi.org/10.18494/SAM.2020.2809
|
|
|
|
|
Cheng, F., Yen, C. & Jeng, T. (2021)
Object recognition and user interface design for vision-based autonomous robotic grasping point determination
, 26th International Conference of the Association for Computer-Aided Architectural Design Research Asia, CAADRIA 2021 (pp. 633-642). The Association for Computer-Aided Architectural Design Research Asia (CAADRIA)
|
|
|
|
|
Flandin, G., Chaumette, F. & Marchand, E. (2000)
Eye-in-hand / Eye-to-hand Cooperation for Visual Servoing
, IEEE International Conference on Robotics and Automation, ICRA 2000, (pp. 2741-2746). Institute of Electrical and Electronics Engineers (IEEE)
|
|
|
|
|
Friedman, J. H. (2002)
Stochastic gradient boosting
, Computational Statistics & Data Analysis, 38(4), 367-378. https://doi.org/https://doi.org/10.1016/S0167-9473(01)00065-2
|
|
|
|
|
Yang, X. & Xu, W. (2021)
A Tool for Searching Active Bending Bamboo Strips in Construction via Deep Learning
, 26th International Conference of the Association for Computer-Aided Architectural Design Research Asia, CAADRIA 2021 (pp.2409-2417). The Association for Computer-Aided Architectural Design Research Asia (CAADRIA)
|
|
|
|
| last changed |
2022/07/22 07:34 |
|
