• 0 Posts
  • 9 Comments
Joined 1 year ago
cake
Cake day: February 19th, 2025

help-circle

  • As someone who had the misfortune to work with Vivado before. I really hope that this might drive a new company/independent dev team to make something better and we get something good out of this.

    I mean it is a huge loss for FOSS since it is one of the only “IDEs” (* if you can even call this buggy bullshit that*) that is free. But it really is shit.

    I really liked Verilog but I could never work with it for longer than an hour before some new Vivado bug needed a restart or I got sick from interacting with the interface.







  • The smallest Modells that I run on my PC take about 6-8 GB of VRAM and would be very slow if I ran them purely with my CPU. So it is unlikely that you Phone has enough RAM and enough Cores to run a decent LLM smootly.

    If you still want to use selfhosted AI with you phone, selfhost the modell on your PC:

    • Install Ollama and OpenWebUI in a docker container (guides can be found on the internet)
    • Make sure they use your GPU (Some AMD Cards require an HSA override Flag to work
    • Make sure the docker container is secure (Blocking the Port for comunication outside of your network should work fine as long as you only use the AI Modell at home)
    • Get youself an openwight modell (I recomend llama 3.1 for 8 GB of VRAM and Phi4 if you got more or have enough RAM)
    • Type the IP-Adress and Port into the browser on your phone.

    You now can use selfhosted AI with your phone and an internet connection.