Skip to content

Feature request: Python bindings for starcoder-cpp #23

Open
Open
Feature request: Python bindings for starcoder-cpp#23

Description

@crk-roblox
crk-roblox
opened on Jun 22, 2023

Similar to this repository for llama-cpp, is anyone aware of efforts to do the same for starcoder-cpp?

More broadly, I'm looking for the best (and easiest) way to get starcoder-cpp to run with Triton server.

Thanks in advance!

Activity

  1. LanceaKing commented on Aug 24, 2023

    @LanceaKing
    LanceaKing
    on Aug 24, 2023

    Maybe you can try ctransformers for now?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions