• exussum@lemmy.world
    link
    fedilink
    arrow-up
    9
    arrow-down
    1
    ·
    11 months ago

    Is pip the real bottle neck in software development? How many dependencies are you managing that require this speed?

    • sugar_in_your_tea@sh.itjust.works
      link
      fedilink
      arrow-up
      12
      ·
      11 months ago

      The longest running tool in our toolchain is pytest, followed somewhat closely by poetry. I work on a project with several teams, so I end up needing to reinstall deps pretty frequently.

      It’s not something I’m actively looking for, but I wouldn’t say no to some improvements. But I need the additional features of poetry, so I probably won’t bother until it gets a bit more sophisticated.

      • takeda@lemmy.world
        link
        fedilink
        arrow-up
        5
        ·
        11 months ago

        The slowness of poetry is mostly due to network bottlenecks. While a Rust based tool, might be faster, it won’t be a dramatic improvement, unlike the one we have seen with Ruff.

        • sugar_in_your_tea@sh.itjust.works
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          11 months ago

          True, but poetry still has a long startup time (probably reading the lock file?) before it gets to the network parts. Also, a lot of the time spent in our projects is compiling/installing dependencies, not downloading them, and at least the install part could probably be sped up (I’m guessing async Rust is faster than whatever Poetry is doing).

          But yeah, I’m not expecting huge wins here, but if it saves me a minute or so when rebuilding my docker images (currently takes >5 min in the poetry part alone), that’s worth taking the time to switch.

          I’m a lot more excited about projects like Ruff though, but any part of the Python tooling ecosystem is interesting.

            • sugar_in_your_tea@sh.itjust.works
              link
              fedilink
              arrow-up
              2
              ·
              11 months ago

              It does for us, ymmv. pip wasn’t that much faster, so the version resolution isn’t our main bottleneck, we just have a lot of packages (like 30 direct deps, and they have their own deps; seems like ~140 packages in our biggest microservice).