# AI navigator not utilizing the GPU

**URL:** <https://forum.anaconda.com/t/ai-navigator-not-utilizing-the-gpu/83533>\
**Category:** Getting Started Information\
**Created:** [September 18, 2024, 5:53am UTC](https://forum.anaconda.com/t/ai-navigator-not-utilizing-the-gpu/83533 "2024-09-18T05:53:03Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mkon](https://avatars.discourse-cdn.com/v4/letter/m/db6015/32.png) [@mkon](https://forum.anaconda.com/u/mkon)\
**Post date:** [September 18, 2024, 5:53am UTC](https://forum.anaconda.com/t/ai-navigator-not-utilizing-the-gpu/83533/1 "2024-09-18T05:53:03Z")

</div>

Hey everyone, I am a bit new to anaconda and I wanted to test out the new AI Navigator however I encountered a problem where the models seem to utilize the CPU and ram and not the GPU. I am in the cuda environment auto generated by AI Navigator and I did not find a setting or working command that can switch to GPU acceleration. Any help is greatly appreciated.

For reference the system I am using is  
CPU: intel 13600k  
Memory: 32 GB RAM  
GPU: 4070 super with 12 GB VRAM

---

<div class="post-metadata">

**Author:** ![lzhou](https://avatars.discourse-cdn.com/v4/letter/l/00a5b5/32.png) [@lzhou](https://forum.anaconda.com/u/lzhou)\
**Post date:** [October 2, 2024, 9:24pm UTC](https://forum.anaconda.com/t/ai-navigator-not-utilizing-the-gpu/83533/2 "2024-10-02T21:24:02Z")

</div>

@mkon , welcome to Anaconda!

I am sorry to hear your experience about AI Navigator not leveraging your GPU.

We have a new version v1.0.2 released on Sep 27, can you update to that version and see if you still experience the same issue?

Also if you can share (either here or my work email: [lzhou@anaconda.com](mailto:lzhou@anaconda.com)):

- Your OS version
- The model that you are having problem with
- Portion of your main.log that related to the issue you were experiencing – you can use the timestamp in the log to determine which portion is relevant

We love to use this information to troubleshoot and improve your experience.

Thank you!

— Leon Zhou

---

<div class="post-metadata">

**Author:** ![Bole](https://avatars.discourse-cdn.com/v4/letter/b/f5a800/32.png) [@Bole](https://forum.anaconda.com/u/Bole)\
**Post date:** [December 30, 2024, 11:29am UTC](https://forum.anaconda.com/t/ai-navigator-not-utilizing-the-gpu/83533/3 "2024-12-30T11:29:54Z")

</div>

Hello! I encountered the same question using anaconda AI navigator, the model seems using my CPU and not the GPU. Could you tell me are there any methods to solve this question? thanks!

CPU: intel 12600kf  
RAM: 32GB  
GPU: 4060ti 16GB  
OS: win11 professional 24H2 26100.2605  
the model i’m using is: Meta-Llama-3-8B-Instruct