Toms Eduards Zinars, Oskars Vismanis, Peteris Racinskis, Janis Arents, Modris Greitans. Model Selection and Prompting Strategies in Resource Constrained Environments for LLM-based Robotic System. Charting the Intelligence Frontiers Edge AI Systems Nexu, 147-165 pp. River Publishers Series in Communications and Networking, 2025.
Bibtex citation:
Bibtex citation:
@article{19791_2025,
author = {Toms Eduards Zinars and Oskars Vismanis and Peteris Racinskis and Janis Arents and Modris Greitans},
title = {Model Selection and Prompting Strategies in Resource Constrained Environments for LLM-based Robotic System},
journal = {Charting the Intelligence Frontiers Edge AI Systems Nexu},
pages = {147-165},
publisher = {River Publishers Series in Communications and Networking},
year = {2025}
}
author = {Toms Eduards Zinars and Oskars Vismanis and Peteris Racinskis and Janis Arents and Modris Greitans},
title = {Model Selection and Prompting Strategies in Resource Constrained Environments for LLM-based Robotic System},
journal = {Charting the Intelligence Frontiers Edge AI Systems Nexu},
pages = {147-165},
publisher = {River Publishers Series in Communications and Networking},
year = {2025}
}
Abstract: Large Language Models (LLMs) are increasingly becoming adopted for various applications in information processing and content generation. Coupled with the diverse availability of model weights, quantization, and fine-tuning, it is desirable to find the best-performing LLM within a certain memory budget. Prompting strategy plays a similarly major role in the quality of generation, with various methods existing that attempt to induce desired behaviour, requiring a major time investment to develop. As new models with better performance to memory ratio become available, it may be tempting to implement them into an existing system for potential performance improvements. In this work we explore the process of changing weights and note that weights from larger models or of different quantization precision are unable to replace the original model without modifications to the prompt contents, which in turn implies complications in developing modular, weight agnostic Systems.