Abstract

The emergence of OpenAI's ChatGPT has sparked significant interest in generative AI within the business sphere. Generative AI APIs are now accessible on mobile devices, which face CPU, memory, and battery resource limitations. To conserve power, a combination of Edge and Cloud Computing can be employed. However, there's a trade-off with response times when implementing these services. Cloud computing tends to incur a higher response time penalty than edge computing, although payload limits and maximum response time constraints restrict the latter. Our testing indicates that Edge Computing strikes a good balance, saving CPU time while partially alleviating the response time penalty. Developers contemplating using Cloud and Edge Computing to save power on mobile devices should carefully evaluate their dataset sizes to determine the feasibility of employing an Edge Computing service.

References

1. P. Taylor, 'Statistica: Number of movile (cellular) subscription sworldwide from 1993 to 2022,' 1 June 2023. [Online]. Available: https://www.statista.com/statistics/262950/global-mobilesubscriptions-since-1993/. [Accessed 7 July 2032].
2. OpenAI, 'Introducting ChatGPT,' 30 November 2022. [Online]. Available: https://openai.com/blog/chatgpt.
3. M. Linares-Vásquez, G. Bavota, C. Bernal-Cárdenas, R. Oliveto, M. Di Penta and D. Poshyvanyk, 'Mining Energy-Greedy API Usage Patterns in Android Apps: An Empirical Study,' in MSR '14, May 31-June 2, 2014, Hyderabad, 2014`.
4. H. Qian and D. Anderson, 'Reducing Mobile Device Energy Consumption with Computation Offloading,' in SNPD 2015, June 1-3 2015, Takamatsu, 2015.
5. OpenAI, 'OpenAI API Reference,' [Online]. Available: https://platform.openai.com/docs/api-reference. [Accessed 27 June 2023].
6. Amazon, 'AWS Lambda Getting Started,' [Online]. Available: https://aws.amazon.com/lambda/getting-started/. [Accessed 28 June 2023].
7. R. Fox and W. Hao, Internet Infrastructure: Networking, Web Services, and Cloud Computing, Boca Raton: CRC Press, 2018.
8. OpenAI, 'OpenAI Libraries,' [Online]. Available: https://platform.openai.com/docs/libraries. [Accessed 28 June 2023].
9. S. Ahmed, 'The Developer Space - How to invoke OpenAI APIs from AWS Lambda functions,' 5 February 2023. [Online]. Available: https://thedeveloperspace.com/how-to-invoke-openai-apis-from-awslambda-functions/. [Accessed 28 June 2023].
10. 'Stackoverflow: Using boto to invoke functions how do I do so asynchronously?,' 12 September 2016. [Online]. Available: https://stackoverflow.com/questions/39456309/using-boto-to-invokelambda-functions-how-do-i-do-so-asynchronously. [Accessed 28 June 2023].
11. Amazon Web Services, 'Boto3 1.26.162 documentation: Lambda,' [Online]. Available: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/lambda.html. [Accessed 28 June 2023].
12. Amazon Web Services, 'Using AWS Lambda with CloudFront Lambda@Edge,' [Online]. Available: https://docs.aws.amazon.com/lambda/latest/dg/lambda-edge.html. [Accessed 30 June 2023].
13. Amazon Web Serivces, 'Restrictions on edge functions,' [Online]. Available:https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/edge-functions-restrictions.html. [Accessed 30 June 2023].
14. Google, 'Android Studio,' [Online]. Available: https://developer.android.com/studio. [Accessed 30 June 2023].

Download PDF
Back