Semi-official read-only Github mirror of the CPython Mercurial repository

Discussion:

Eli Bendersky

2013-09-30 13:09:48 UTC

Hi all,

https://github.com/python/cpython is now live as a semi-official, *read
only* Github mirror of the CPython Mercurial repository. Let me know if you
have any problems/concerns.

I still haven't decided how often to update it (considering either just N
times a day, or maybe use a Hg hook for batching). Suggestions are welcome.

The methodology I used to create it is via hg-fast-export. I also tried to
pack and gc the git repo as much as possible before the initial Github push
- it went down from almost ~2GB to ~200MB (so this is the size of a fresh
clone right now).

Eli

P.S. thanks Jesse for the keys to https://github.com/python

Donald Stufft

2013-09-30 13:54:04 UTC

Permalink

Post by Eli Bendersky
Hi all,
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
I still haven't decided how often to update it (considering either just N times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also tried to pack and gc the git repo as much as possible before the initial Github push - it went down from almost ~2GB to ~200MB (so this is the size of a fresh clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
_______________________________________________
Python-Dev mailing list
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: https://mail.python.org/mailman/options/python-dev/donald%40stufft.io

Awesome! I find Github way nicer for reading source than hg.python.org's web interface, any chance I could convince you to do this for the peps repo too? ;)

-----------------
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

Eli Bendersky

2013-09-30 13:58:49 UTC

Permalink

Post by Eli Bendersky
https://github.com/python/cpython is now live as a semi-official, *read
only* Github mirror of the CPython Mercurial repository. Let me know if you
have any problems/concerns.
I still haven't decided how often to update it (considering either just N
times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also tried to
pack and gc the git repo as much as possible before the initial Github push
- it went down from almost ~2GB to ~200MB (so this is the size of a fresh
clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
_______________________________________________
Python-Dev mailing list
https://mail.python.org/mailman/listinfo/python-dev
https://mail.python.org/mailman/options/python-dev/donald%40stufft.io
Awesome! I find Github way nicer for reading source than hg.python.org's
web interface, any chance I could convince you to do this for the peps repo
too? ;)

Yes, that shouldn't pose a problem. I'll let it hum for a couple of days
just to see everything is OK and then I'll add peps too.

Eli

Eli Bendersky

2013-10-08 13:41:11 UTC

Permalink

Post by Eli Bendersky
Hi all,
https://github.com/python/cpython is now live as a semi-official, *read
only* Github mirror of the CPython Mercurial repository. Let me know if you
have any problems/concerns.
I still haven't decided how often to update it (considering either just N
times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also tried to
pack and gc the git repo as much as possible before the initial Github push
- it went down from almost ~2GB to ~200MB (so this is the size of a fresh
clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
_______________________________________________
Python-Dev mailing list
https://mail.python.org/mailman/listinfo/python-dev
https://mail.python.org/mailman/options/python-dev/donald%40stufft.io
Awesome! I find Github way nicer for reading source than hg.python.org's
web interface, any chance I could convince you to do this for the peps repo
too? ;)

Here you go - https://github.com/python/peps

Both mirrors are currently updated twice per night (23:00 and 04:30 US
Pacific time). I may switch over to a VPS at some point and have more
regular updates.

Eli

Skip Montanaro

2013-09-30 14:08:12 UTC

Permalink

Post by Eli Bendersky
https://github.com/python/cpython is now live as a semi-official, *read
only* Github mirror of the CPython Mercurial repository. Let me know if you
have any problems/concerns.

Thanks for this, Eli. I use git regularly at work, so I'm getting much
more comfortable with it. Do you have a suggested workflow for people
who might want to use Git in preference to Hg, but still have write
access?

Skip

Eli Bendersky

2013-09-30 15:33:21 UTC

Permalink

Post by Skip Montanaro

Post by Eli Bendersky
https://github.com/python/cpython is now live as a semi-official, *read
only* Github mirror of the CPython Mercurial repository. Let me know if

you

Post by Eli Bendersky
have any problems/concerns.

Petri Lehtinen runs a clone at https://github.com/akheron/cpython which
uses more advanced tricks like hg-git and his own git-hg wrapper to allow
him to do this, AFAIK. If this path is important for you, contact Petri and
he can provide guidance on how to set it up.

For python/cpython I really wanted the simplest flow to reach a read-only
stage, because I lack the necessary git/hg-fu to set up and maintain
something more complex "semi-officially". I think the most common workflow
is to do small changes vs. Mercurial anyway. When I'm working on
longer-term patches I do them in my Git mirror (because I prefer Git
branching) and then apply & test patches onto a Mercurial R/W clone before
committing.

Thus, for most users I think the read-only mirror is preferable because
it's much easier to use and reason about. All writes go solely through
Mercurial, so it's clear where the official source is :)

Eli

Eli Bendersky

2014-07-12 13:15:31 UTC

Permalink

Just a quick update on this. I've finally found time to set up a VPS at
DigitalOcean of myself, and I'm moving the cronjob for updating the Github
mirrors to it. This lets me ramp up the update frequency. For now I'll set
it to every 4 hours, but in the future I may make it even more frequent.
Hopefully this will not overrun my bandwidth allocation :)

The CPython mirror (https://github.com/python/cpython) has been pretty
popular so far, with over 70 forks.

Eli