Skip to content

We have to move monitoring on it's own VM #89

Closed

Description

@alexgarel

Describe the bug
All the monitoring infrastructure is on preprod 200 and this is absolutly not a good idea.
Every-time we want to update the preprod data (the zfs clone containing sto), we have to reboot the machine.

Expected behavior

I propose to put monitoring on it's own container, because it is far better when monitoring is independent !

(I propose to gain on 105 or 103 machines resources).

Activity

  1. alexgarel commented on Feb 2, 2022

    @alexgarel
    MemberAuthor

    @CharlesNepote and @cquest do you agree ?

  2. alexgarel commented on Feb 2, 2022

    @alexgarel
    MemberAuthor

    #81 also have the same issue

  3. self-assigned this
    on Feb 2, 2022
  4. alexgarel commented on Feb 2, 2022

    @alexgarel
    MemberAuthor

    @CharlesNepote could we provision a QEMU VM, possibly on ovh1.

    I'm not sure how much resource we need. But I can look into it.

  5. alexgarel commented on Feb 2, 2022

    @alexgarel
    MemberAuthor

    I would give:

    • at least 150 Go disk (it is currently around 15G, but this will grow a lot (because of elasticsearch indexing logs))
    • possibly 8 cpus (2 for ES, 1 for influx, 1 for prometheus, 1 for the rest, 3 for the querying tools grafana / ES)
    • 25 Go (ES needs 12Go, prometheus 3Go, the rest is divided between remaining + a margin of 5Go)

    @CharlesNepote could we provision this on ovh1 as a QEMU VM ?

    It will then be quite easy to move the monitoring stack there.

  6. changed the title [-]We have to move monitoring to 201 or in it's own VM[/-] [+]We have to move monitoring on it's own VM[/+] on Oct 11, 2022
  7. cquest commented on Oct 11, 2022

    @cquest
    Contributor

    Own VM or separate hardware outside of the free+OVH bare metals ?

  8. alexgarel commented on Oct 13, 2022

    @alexgarel
    MemberAuthor

    @cquest do you have a proposition ?

    If we want to lend a server outside, I would take one either in OVH, different DC or at Scaleway

    • scaleway dedibox start-2L is around 50€/month (Vat incl.)
    • ovh elite vps is around this or more…

    @CharlesNepote ?

  9. CharlesNepote commented on Oct 17, 2022

    @CharlesNepote
    Member

    Let's start with OVH1 I guess. We still have 400 GB of disk and 190 GB RAM free on OVH1, let's use it!

    Be aware it is easy to increase disk space of the VM while decreasing is not. So I would start with a machine with 80 GB and increase it when needed.

    Own VM or separate hardware outside of the free+OVH bare metals ?

    @cquest: why a separate machine?

  10. alexgarel commented on Oct 17, 2022

    @alexgarel
    MemberAuthor

    I think we'd better start on OVH1 and then move if someone sponsors us a VM.

  11. alexgarel commented on Nov 9, 2022

    @alexgarel
    MemberAuthor

    created the ticket for the VM, I will now create the VM.

  12. alexgarel commented on Nov 21, 2022

    @alexgarel
    MemberAuthor

    It's done:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions