(Removed from [email protected] since it was apparently not related to self host)

Hello, Since 2 weeks I investigate in my whole homelab the cause of an issue. Let me explain it :

I experience slow network speed when accessing my services from outside (outside local network without a VPN to connect directly into it).

Context :

My local network is all in 1Gb, my ISP download and upload speeds are 500Mb each.

Setup :

Since a while I set up a Librespeed server to be able to benchmark speed to my homelab from everywhere. When doing a direct connection from GbE pc to server, I get perfectly 1000Mb (more or less) symmetric speeds.

I was running caddy to reverse proxy it, and basically when connecting trough the domain (therefore trough the proxy) locally I got 980Mb (Surely the overhead that is caused by https and having one more hope).

(And I need to mention that when doing fast[dot]com, speedtest[dot]net or even librespeed[dot]org speedtests I got roughly 500Mb symmetric speeds, my ISP wasn’t lying)

So for now all of it is okay and working as intended.

Issue :

Here comes the problem when doing a speed test to my server (so trough speed.example.com) from a friend computer (who got 450 and 400 Mb on librespeed[dot]org servers), he got around 100Mb download (so homelab upload) and 400Mb up.

Tried other scenarios, from my home (the same where is located the homelab), I connect to the internet trough protonVPN or windscribe (all free tier).

While I was getting around 300-400Mb from librespeed[dot]org servers. I was sometimes getting 7-8Mb from speed.example.com (my libre speed install).

Even when working better I only got something like 80 down and 200 up, better but I was always really lower than popular speedtests or just a bit that could be somehow be margin error (around 40Mb on 400Mb), but was always here, it was not able to get right speeds.

Potential issue with librespeed :

Thinking that librespeed was not working good, so I tried to make a file transfer in file browser service, (Tried going trough and around caddy), getting around 100-110MB per sec without any VPN, going down to 8MB when transferring from the VPN.

Iperf got the same results around 100Mb of transfer speed going from VPN instead of 500Mb.

Maybe this isn’t really clear but I’d be really happy and respectful if someone could help me with this. Feel free to ask questions. :)

EDIT : tried to use nginx but this was even worse as even locally the speeds are not stable at all (not able to have full gigs local speeds) But don’t worry this is an other problem I will maybe resolve later

And little question, does WAN 500/500 speeds means that I can use 500Mb up and down at the same time, or that I can only use 250 each a the same time?

  • CameronDev@programming.dev
    2·
    3 days ago

    500/500 should be at the same time, as far as I know. Most tech seems to work that way anyway.

    I wonder if your ISP is doing some kind of traffic analysis, where private to private addresses are slower than private to datacenter/commercial addresses?

    Would explain the fast speeds between you and speedtest, and the VPN and speedtest? You didn’t say where the VPN endpoint was, but that might rule that out.

    • foremanguy@lemmy.mlOP
      2·
      3 days ago

      I’m not getting right results when doing from residential IP to mine or datacenter IP to mine. Tried to get the endpoint of the VPN in foreigners countries or the same as mine, it didn’t change anything.

      Basically I get 500/500 when connecting to speedtest[dot]net without or with ProtonVPN

      But when connecting to MY speedteet with ProtonVPN I only get as low as 8Mb sometimes or sometimes 100Mb, but ProtonVPN speedtest on speedtest[dot]net shows 400/400

        • foremanguy@lemmy.mlOP
          2·
          3 days ago

          That’s what I thought but don’t think librespeed servers could be prioritized…

          Don’t to mention that when I download stuff from internet I can easily get 60MB/s (~500Mb)

            • foremanguy@lemmy.mlOP
              2·
              3 days ago

              Tried ProtonVPN and Windscribe both getting really slow results, the speed test is not CPU bottleneck at all, running at around 50% when doing the heavy stuff

              • CameronDev@programming.dev
                1·
                3 days ago

                So, not a VPN to the homelab (tailscale/wireguard/etc)?

                Google/reddit suggests windscribe can be pretty slow, and proton VPN free tier is slow. Are you getting good results through them to regular speedtest?

                • foremanguy@lemmy.mlOP
                  2·
                  3 days ago

                  Don’t know if I didn’t explain correctly if my post but I already said it.

                  Don’t worry gonna recap it, I wanted to use a commercial VPN to access my self host speedtest from outside of my network, so I used wind scribe and protonvpn free tier.

                  As said both are getting pretty nice speeds, I wasn’t getting the full 500Mb like I didn’t have one, but I was getting about 300-400Mb which is nice but connecting to my speed test returned my only 10Mb sometimes or 100Mb but not at all the 300-400 from other speedtests

                  • CameronDev@programming.dev
                    1·
                    3 days ago

                    You probably did explain it correctly, Im not the best reader :).

                    You could try tailscale for a direct VPN to your server, see if that bypasses the free tier vpn issues? Tailscale will route your traffic directly between your two points, instead of via a server, so it might save some routing overhead? Its also free if that helps.