Skip to content
This repository was archived by the owner on Oct 3, 2026. It is now read-only.
This repository was archived by the owner on Oct 3, 2026. It is now read-only.

About GraphEngine Data Loading #293

Open

Description

@simple221

I need to store 600G of data, but only 32G of computer memory, the program will prompt memory overflow, how to solve, what solutions?

Activity

  1. TaviTruman commented on Sep 24, 2019

    @TaviTruman
    Contributor

    simple221 The GE is an In-Memory Graph Engine so if you want to load 600GB resident in RAM you will ultimately need available memory to load your data. The GE is a distributed memory cloud so you can load the data across what it "AvailabilityGroup" facility. Here is an excerpt from the GE Developer's Guide:

    https://github.com/Microsoft/GraphEngine/wiki/config-v2

    image

    The GE also allows you to configure "Storage" nodes; you are going to want to experience with "TrunkCount" and "StorageCapacity" attributes.

  2. simple221 commented on Sep 25, 2019

    @simple221
    Author

    simple221 The GE is an In-Memory Graph Engine so if you want to load 600GB resident in RAM you will ultimately need available memory to load your data. The GE is a distributed memory cloud so you can load the data across what it "AvailabilityGroup" facility. Here is an excerpt from the GE Developer's Guide:

    https://github.com/Microsoft/GraphEngine/wiki/config-v2

    image

    The GE also allows you to configure "Storage" nodes; you are going to want to experience with "TrunkCount" and "StorageCapacity" attributes.
    okay,thank you.but i need stand-alone support.So maybe there's no solve.

  3. TaviTruman commented on Sep 26, 2019

    @TaviTruman
    Contributor

    simple221 Yes, if you need to run "stand-alone" on a single machine then and need to have all 600 GB loaded on then you would need to have available RAM on it. Unlike a lot of other Graph Engines that GE is an in-memory cloud; it does have a persistent storage capability so you can write to disk what you load into RAM so as to save it.

  4. simple221 commented on Sep 27, 2019

    @simple221
    Author

    Tavi Truman (@TaviTruman) thank you.I see now.

  5. TaviTruman commented on Oct 2, 2019

    @TaviTruman
    Contributor

    simple221 if you're good with the explanation here you can close this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions