{"id":418,"date":"2024-03-22T23:58:37","date_gmt":"2024-03-23T03:58:37","guid":{"rendered":"https:\/\/utkarshchoudhary.com\/?p=418"},"modified":"2024-03-22T23:58:38","modified_gmt":"2024-03-23T03:58:38","slug":"running-your-chatgpt-like-llm-locally-on-docker-containers","status":"publish","type":"post","link":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/","title":{"rendered":"Running your ChatGPT-like LLM locally on docker containers"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image.png\" alt=\"\" class=\"wp-image-419\" style=\"width:865px;height:auto\" srcset=\"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image.png 1024w, https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image-300x300.png 300w, https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image-150x150.png 150w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"418c\">Introduction:<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\" id=\"e244\">In today\u2019s data-driven world, the demand for advanced natural language processing (NLP) capabilities has surged. Large language models (LLMs) have emerged as powerful tools for tasks ranging from text generation to sentiment analysis. However, concerns regarding data privacy and security have led to a growing preference for running LLMs locally. In this article, we\u2019ll explore how Docker containers and Docker Compose streamline the deployment of Ollama, a tool for running open-source LLMs locally, while enhancing data privacy and security.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"ce7b\">Introducing Docker Containers<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\" id=\"37b7\">Docker containers have revolutionized software deployment by providing a lightweight, portable, and isolated environment for running applications. Containers encapsulate an application and its dependencies, ensuring consistent behavior across different environments. With Docker, developers can package their applications into containers, making deployment seamless and efficient.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\" id=\"107d\">A more comprehensive introduction on how to run applications on docker containers can be found&nbsp;<a href=\"https:\/\/docker-curriculum.com\/\" rel=\"noreferrer noopener\" target=\"_blank\">here<\/a>. A rather quicker-to-do version of is available&nbsp;<a href=\"https:\/\/medium.com\/@gayankurukulasooriya\/dockerizing-applications-a-step-by-step-guide-92c0494bba3d\">here<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\" id=\"8590\">For the ones loving the visual (GUI) way of doing things, try portainer.io! (Link&nbsp;<a href=\"https:\/\/levelup.gitconnected.com\/portainer-the-easy-way-to-manage-docker-a982a17146c1\" rel=\"noreferrer noopener\" target=\"_blank\">here<\/a>)<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"4a34\">Understanding the Shift to Local LLM Execution<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\" id=\"816e\">In recent years, there has been a noticeable shift towards executing LLMs locally. This shift is driven by concerns surrounding data privacy and security. Organizations and individuals are increasingly wary of entrusting sensitive data to cloud-based services, where data may be vulnerable to breaches or unauthorized access. By running LLMs locally, users gain greater control over their data and can ensure compliance with privacy regulations.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"488b\">Introducing Ollama: A Solution for Local LLM Execution<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\" id=\"7dea\"><a href=\"https:\/\/ollama.com\/\" rel=\"noreferrer noopener\" target=\"_blank\">Ollama<\/a>&nbsp;addresses the need for local LLM execution by providing a streamlined tool for running open-source LLMs locally. By bundling model weights, configurations, and datasets into a unified package managed by a Modelfile, Ollama simplifies the deployment process while preserving data privacy and security.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"63f7\">Leveraging Docker Compose for Ollama Deployment<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\" id=\"e518\">Docker Compose offers a convenient way to deploy Ollama, enabling users to define and run multi-container Docker applications with ease. As from the hyperlinks in the earlier section you must have understood how to run applications on docker, we\u2019ll directly jump into how Docker Compose can be used to deploy Ollama, ensuring that both the backend and web UI components are securely encapsulated within Docker containers. Here is the docker compose for you:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>version: '3.8'\r\n\r\nservices:\r\n  ollama-backend:\r\n    image: ollama\/ollama\r\n    ports:\r\n      - \"11434:11434\"\r\n    volumes:\r\n      - \/ollama:\/root\/.ollama\r\n    restart: always\r\n    container_name: ollama-backend\r\n\r\n  ollama-openweb-ui:\r\n    image: ghcr.io\/open-webui\/open-webui:main\r\n    ports:\r\n      - \"3000:8080\"\r\n    environment:\r\n      - OLLAMA_API_BASE_URL=http:\/\/ollama-backend:11434\/api\r\n    depends_on:\r\n      - ollama-backend\r\n    restart: always\r\n    container_name: ollama-openweb-ui<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">Docker Compose will build and start the containers based on the specifications in the\u00a0<code>docker-compose.yml<\/code>\u00a0file as we wrote above, exposing the webUI on host port 3000.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\"><em>By running LLMs locally with Ollama, users can mitigate the risks associated with cloud-based services. Data remains within the user\u2019s control, reducing the likelihood of unauthorized access or data breaches. Furthermore, running LLMs locally minimizes exposure to third-party services, enhancing overall data privacy and security.<\/em><\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>Introduction: In today\u2019s data-driven world, the demand for advanced natural language processing (NLP) capabilities has surged. Large language models (LLMs) have emerged as powerful tools for tasks ranging from text generation to sentiment analysis. However, concerns regarding data privacy and security have led to a growing preference for running LLMs locally. In this article, we\u2019ll &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/\" class=\"more-link\">Read more<span class=\"screen-reader-text\"> &#8220;Running your ChatGPT-like LLM locally on docker containers&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":419,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[23],"tags":[26,24,25,14],"class_list":["post-418","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-chatgpt","tag-docker","tag-llm","tag-technology"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Running your ChatGPT-like LLM locally on docker containers - Utkarsh&#039;s Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Running your ChatGPT-like LLM locally on docker containers - Utkarsh&#039;s Blog\" \/>\n<meta property=\"og:description\" content=\"Introduction: In today\u2019s data-driven world, the demand for advanced natural language processing (NLP) capabilities has surged. Large language models (LLMs) have emerged as powerful tools for tasks ranging from text generation to sentiment analysis. However, concerns regarding data privacy and security have led to a growing preference for running LLMs locally. In this article, we\u2019ll &hellip; Read more &quot;Running your ChatGPT-like LLM locally on docker containers&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/\" \/>\n<meta property=\"og:site_name\" content=\"Utkarsh&#039;s Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/utkarsh121\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/utkarsh121\" \/>\n<meta property=\"article:published_time\" content=\"2024-03-23T03:58:37+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-03-23T03:58:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Utkarsh\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@utkarsh121\" \/>\n<meta name=\"twitter:site\" content=\"@utkarsh121\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Utkarsh\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/\"},\"author\":{\"name\":\"Utkarsh\",\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/#\\\/schema\\\/person\\\/7a3c37bdc3b7eab320da0d28c7658fbe\"},\"headline\":\"Running your ChatGPT-like LLM locally on docker containers\",\"datePublished\":\"2024-03-23T03:58:37+00:00\",\"dateModified\":\"2024-03-23T03:58:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/\"},\"wordCount\":456,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/#\\\/schema\\\/person\\\/7a3c37bdc3b7eab320da0d28c7658fbe\"},\"image\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/utkarshchoudhary.com\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/image.png\",\"keywords\":[\"ChatGPT\",\"Docker\",\"LLM\",\"Technology\"],\"articleSection\":[\"Technology\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/\",\"url\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/\",\"name\":\"Running your ChatGPT-like LLM locally on docker containers - Utkarsh&#039;s Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/utkarshchoudhary.com\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/image.png\",\"datePublished\":\"2024-03-23T03:58:37+00:00\",\"dateModified\":\"2024-03-23T03:58:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/#primaryimage\",\"url\":\"https:\\\/\\\/utkarshchoudhary.com\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/image.png\",\"contentUrl\":\"https:\\\/\\\/utkarshchoudhary.com\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/image.png\",\"width\":1024,\"height\":1024},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/2024\\\/03\\\/22\\\/running-your-chatgpt-like-llm-locally-on-docker-containers\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/utkarshchoudhary.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Running your ChatGPT-like LLM locally on docker containers\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/#website\",\"url\":\"https:\\\/\\\/utkarshchoudhary.com\\\/\",\"name\":\"Utkarsh&#039;s Blog\",\"description\":\"Utkarsh&#039;s Blog\",\"publisher\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/#\\\/schema\\\/person\\\/7a3c37bdc3b7eab320da0d28c7658fbe\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/utkarshchoudhary.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/#\\\/schema\\\/person\\\/7a3c37bdc3b7eab320da0d28c7658fbe\",\"name\":\"Utkarsh\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/21-04-08-13-26-26-0455-01-scaled.jpeg\",\"url\":\"https:\\\/\\\/utkarshchoudhary.com\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/21-04-08-13-26-26-0455-01-scaled.jpeg\",\"contentUrl\":\"https:\\\/\\\/utkarshchoudhary.com\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/21-04-08-13-26-26-0455-01-scaled.jpeg\",\"width\":1923,\"height\":2560,\"caption\":\"Utkarsh\"},\"logo\":{\"@id\":\"https:\\\/\\\/utkarshchoudhary.com\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/21-04-08-13-26-26-0455-01-scaled.jpeg\"},\"sameAs\":[\"https:\\\/\\\/utkarshchoudhary.com\",\"https:\\\/\\\/www.facebook.com\\\/utkarsh121\",\"https:\\\/\\\/www.instagram.com\\\/utkarsh121\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/utkarsh121\\\/\",\"https:\\\/\\\/x.com\\\/utkarsh121\"],\"url\":\"https:\\\/\\\/utkarshchoudhary.com\\\/index.php\\\/author\\\/admin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Running your ChatGPT-like LLM locally on docker containers - Utkarsh&#039;s Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/","og_locale":"en_US","og_type":"article","og_title":"Running your ChatGPT-like LLM locally on docker containers - Utkarsh&#039;s Blog","og_description":"Introduction: In today\u2019s data-driven world, the demand for advanced natural language processing (NLP) capabilities has surged. Large language models (LLMs) have emerged as powerful tools for tasks ranging from text generation to sentiment analysis. However, concerns regarding data privacy and security have led to a growing preference for running LLMs locally. In this article, we\u2019ll &hellip; Read more \"Running your ChatGPT-like LLM locally on docker containers\"","og_url":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/","og_site_name":"Utkarsh&#039;s Blog","article_publisher":"https:\/\/www.facebook.com\/utkarsh121","article_author":"https:\/\/www.facebook.com\/utkarsh121","article_published_time":"2024-03-23T03:58:37+00:00","article_modified_time":"2024-03-23T03:58:38+00:00","og_image":[{"width":1024,"height":1024,"url":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image.png","type":"image\/png"}],"author":"Utkarsh","twitter_card":"summary_large_image","twitter_creator":"@utkarsh121","twitter_site":"@utkarsh121","twitter_misc":{"Written by":"Utkarsh","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/#article","isPartOf":{"@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/"},"author":{"name":"Utkarsh","@id":"https:\/\/utkarshchoudhary.com\/#\/schema\/person\/7a3c37bdc3b7eab320da0d28c7658fbe"},"headline":"Running your ChatGPT-like LLM locally on docker containers","datePublished":"2024-03-23T03:58:37+00:00","dateModified":"2024-03-23T03:58:38+00:00","mainEntityOfPage":{"@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/"},"wordCount":456,"commentCount":0,"publisher":{"@id":"https:\/\/utkarshchoudhary.com\/#\/schema\/person\/7a3c37bdc3b7eab320da0d28c7658fbe"},"image":{"@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/#primaryimage"},"thumbnailUrl":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image.png","keywords":["ChatGPT","Docker","LLM","Technology"],"articleSection":["Technology"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/","url":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/","name":"Running your ChatGPT-like LLM locally on docker containers - Utkarsh&#039;s Blog","isPartOf":{"@id":"https:\/\/utkarshchoudhary.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/#primaryimage"},"image":{"@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/#primaryimage"},"thumbnailUrl":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image.png","datePublished":"2024-03-23T03:58:37+00:00","dateModified":"2024-03-23T03:58:38+00:00","breadcrumb":{"@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/#primaryimage","url":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image.png","contentUrl":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2024\/03\/image.png","width":1024,"height":1024},{"@type":"BreadcrumbList","@id":"https:\/\/utkarshchoudhary.com\/index.php\/2024\/03\/22\/running-your-chatgpt-like-llm-locally-on-docker-containers\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/utkarshchoudhary.com\/"},{"@type":"ListItem","position":2,"name":"Running your ChatGPT-like LLM locally on docker containers"}]},{"@type":"WebSite","@id":"https:\/\/utkarshchoudhary.com\/#website","url":"https:\/\/utkarshchoudhary.com\/","name":"Utkarsh&#039;s Blog","description":"Utkarsh&#039;s Blog","publisher":{"@id":"https:\/\/utkarshchoudhary.com\/#\/schema\/person\/7a3c37bdc3b7eab320da0d28c7658fbe"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/utkarshchoudhary.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":["Person","Organization"],"@id":"https:\/\/utkarshchoudhary.com\/#\/schema\/person\/7a3c37bdc3b7eab320da0d28c7658fbe","name":"Utkarsh","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2022\/07\/21-04-08-13-26-26-0455-01-scaled.jpeg","url":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2022\/07\/21-04-08-13-26-26-0455-01-scaled.jpeg","contentUrl":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2022\/07\/21-04-08-13-26-26-0455-01-scaled.jpeg","width":1923,"height":2560,"caption":"Utkarsh"},"logo":{"@id":"https:\/\/utkarshchoudhary.com\/wp-content\/uploads\/2022\/07\/21-04-08-13-26-26-0455-01-scaled.jpeg"},"sameAs":["https:\/\/utkarshchoudhary.com","https:\/\/www.facebook.com\/utkarsh121","https:\/\/www.instagram.com\/utkarsh121","https:\/\/www.linkedin.com\/in\/utkarsh121\/","https:\/\/x.com\/utkarsh121"],"url":"https:\/\/utkarshchoudhary.com\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/posts\/418","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/comments?post=418"}],"version-history":[{"count":1,"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/posts\/418\/revisions"}],"predecessor-version":[{"id":420,"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/posts\/418\/revisions\/420"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/media\/419"}],"wp:attachment":[{"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/media?parent=418"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/categories?post=418"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/utkarshchoudhary.com\/index.php\/wp-json\/wp\/v2\/tags?post=418"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}