Any FOSS apps for the Linux CLI that can summarize a large text into short paragraphs or bullet points?

  • 257m@lemmy.ml
    link
    fedilink
    arrow-up
    5
    ·
    edit-2
    1 year ago

    You can use tldr for man pages but for generic text I don’t know. You would probably need a LLM.

    • zoe@infosec.pub
      link
      fedilink
      arrow-up
      1
      arrow-down
      1
      ·
      1 year ago

      could anyone recommend an LLM that could be run locally or on google colab ? thanks

      • 257m@lemmy.ml
        link
        fedilink
        arrow-up
        4
        ·
        edit-2
        1 year ago

        I believe Llama is open source but not sure how complicated it is to get running locally. Nevermind: https://replicate.com/blog/run-llama-locally

        You can probably write a bash wrapper around it that feeds in “Can you summarize this text: (text here)” by setting the PROMPT variable the bash script. (Probably just do PROMPT=“Can you summarize this text: $1”) (Obviously don’t recompile everytime so remove the clone build and download code)