Forums : Suggestions for Ohloh 2.0

Apache Synapse recently became a Top Level Project (TLP) of the Apache Software Foundation and thus moved into our own domain synapse.apache.org

This required that we move our SVN as well, and now ohloh thinks that Synapse is just one month old ?! Can someone fix this issue ASAP..

asankha about 17 years ago

Sorry, asankha, you've just bumped up against a limitation of the Ohloh Subversion importer. We are unable to follow development activity across branches or directory moves.

If you get your log using the --stop-on-copy option, you will see your project the way Ohloh sees it.

As far as I can tell there is no workaround. This affects a lot of projects, and I desperately want to get this fixed, but it will take some time.

Robin

Robin Luckey about 17 years ago

Robin

This is just not good enough.. if ohloh can't even track such a common svn switch which affects a lot of projects and you cannot fix this even in 4 months, I think someone should start blogging on how ineffective ohloh would be under these circumstances.. Can you give me an ETA for this fix?

asankha

asankha almost 17 years ago

Asankha,

As you've surmised, fixing this problem hasn't been our highest priority. As much as we hate to disappoint anyone, this problem simply doesn't rank as high as driving & monetizing ohloh adoption. Unfortunately, there is no current ETA.

There are work arounds: you could create an historical Synapse repository and add it to your project, for example.

Meanwhile, I sincerely encourage you to blog about Ohloh as often as you can - we could always use the coverage.

Jason Allen almost 17 years ago

Jason

I tried to create a historical repository.. but it seems like it suffers from the same problem since what I can do is a svn cp... and the --stop-on-copy option makes that useless..

Can you help me with some details on how could try your suggested workaround?

asankha

asankha almost 17 years ago

So you want coverage? Well, given all the features that people report so often and developers have no time to work on because of so many other features in the list, add me on the survey as wouldn't (yet) recommend Ohloh to other open source projects.

Every feature I'm interested in seems to be low on list compared to others. Wonder which are the others?

nicolas-17 almost 17 years ago

@asankha - I kinda dropped you in the deep-end - sorry about that. Here's some more prescriptive steps that I believe should work (no guarantees though).

1. Clone your synapse subversion trunk into Git - git-svn clone http://svn.apache.org/repos/asf/synapse/trunk/java synapse
2. Find the SHA1 of the commit that resulted in the promotion of SYNAPSE into its own tree.
3. Git revert just prior to that commit.
4. Now create a new Git commit containing the deletion of all files in this new Git repo.
5. Move this historical GIT tree up to a publicly accessible place (github?).
6. Enlist your ohloh project into this historical tree.

Wheh! This should, theoretically, solve the problem. YOu might run into problems along the way. Contact me via ohloh messaging (@jason) or jabber(jasonallen@gmail.com) if you run into any problem/questions.

Jason Allen almost 17 years ago

@nicolas-17 I hear your frustration. We're a small team w/ a lot manage. I think I clearly stated our focus above (monetization).

Btw, I'm always up for a chat on Ohloh's defiencies (or praises!). Come join our IRC conversation on #ohloh at irc.freenode.net (or Jabber at jasonallen@gmail.com). Peace!

Jason Allen almost 17 years ago

Hi Jason

Thanks for your guidelines, I think I can again believe this is somehow possible now..

I tried your steps, but run into some issues.. btw this is my first time with git.. hope you can help me

asankha@asankha:~/GIT$ git-svn clone http://svn.apache.org/repos/asf/synapse/trunk/java synapse
Initialized empty Git repository in .git/
W: Ignoring error from SVN, path probably does not exist: (175007): HTTP Path Not Found: REPORT request failed on '/repos/asf/!svn/bc/100/synapse/trunk/java': '/repos/asf/!svn/bc/100/synapse/trunk/java' path not found

After that it almost seems like its done.. or stuck.. and inside the synapse directory created, I see no files :(..

Can you try to replicate the Synapse repo to see if there is some problems with it?

thanks
asankha

asankha almost 17 years ago

Hi asankha,

I tried running it locally here at the ohloh offices, but didn't get anywhere because our friends at apache have turned off access from the ohloh offices (they didn't like an early version of our crawler... long story). I'll attempt again later tonight from home.

Jason Allen almost 17 years ago

ok - I'm running it from home and it appears to be importing. It's taking quite a while so I'll let it run overnight. Btw, I ran this command:

svn clone --trunk=trunk --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse

I'll report back in the morning.

Jason Allen almost 17 years ago

Hi Jason

Did your clone complete successfully? When I try that, I still get the warning below:

asankha@asankha:~/GIT$ git svn clone --trunk=trunk --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse
Initialized empty Git repository in .git/
Using higher level of URL: http://svn.apache.org/repos/asf/synapse => http://svn.apache.org/repos/asf
W: Ignoring error from SVN, path probably does not exist: (160013): Filesystem has no item: REPORT request failed on '/repos/asf/!svn/bc/100': File not found: revision 100, path '/synapse'

But it only pulls down 168K of stuff :(

asankha@asankha:~/GIT$ du -h
108K ./synapse/.git/svn/trunk
112K ./synapse/.git/svn
4.0K ./synapse/.git/info
0 ./synapse/.git/refs/tags
0 ./synapse/.git/refs/heads
0 ./synapse/.git/refs
40K ./synapse/.git/hooks
0 ./synapse/.git/branches
0 ./synapse/.git/objects/info
0 ./synapse/.git/objects/pack
0 ./synapse/.git/objects
168K ./synapse/.git
168K ./synapse
168K .

Hopefully I am doing something wrong ?

thanks
asankha

asankha almost 17 years ago

Jason

I left the git clone running from morning till evening, and here is what I got:

asankha@asankha:~/GIT$ git svn clone --trunk=trunk --tags=tags --branches=branches http://svn.apache.org/repos/asf/synapse
Initialized empty Git repository in .git/
Using higher level of URL: http://svn.apache.org/repos/asf/synapse => http://svn.apache.org/repos/asf
W: Ignoring error from SVN, path probably does not exist: (160013): Filesystem has no item: REPORT request failed on '/repos/asf/!svn/bc/100': File not found: revision 100, path '/synapse'
W: Ignoring error from SVN, path probably does not exist: (175002): RA layer request failed: PROPFIND request failed on '/repos/asf/!svn/vcc/default': PROPFIND of '/repos/asf/!svn/vcc/default': 502 Bad Gateway (http://svn.apache.org)
W: Ignoring error from SVN, path probably does not exist: (175002): RA layer request failed: PROPFIND request failed on '/repos/asf': PROPFIND of '/repos/asf': could not connect to server (http://svn.apache.org)
Path 'synapse' was probably deleted:
RA layer request failed: PROPFIND request failed on '/repos/asf': PROPFIND of '/repos/asf': could not connect to server (http://svn.apache.org)
Will attempt to follow revisions r675401 .. r675436 committed before the deletion

It however created a file 27MB, and full of just 0 (zeros!) and nothing else: .git/svn/trunk/.rev_db.13f79535-47bb-0310-9956-ffa450edef68

If you were able to get anywhere, please give me the full commands that works

thanks
asankha

asankha almost 17 years ago

hi asankha. Saw your post on MARC. I'm trying to install the latest Git from HEAD to see if the later ones work.

I suspect one of the problems we might be running into is the fact that the Apache Svn repo is one single GIANT repo. Might be the cause of the weird behaviour.

Anyway - i'll try again and report back...

Jason Allen almost 17 years ago

Hi Jason

Any luck with the latest Git? I understand that Apache SVN maybe one of the largest repos around, and its going to be difficult to try many options.. Why does Ohloh depend on the --stop-on-copy option? Can there be a workaround to overcome this limitation while still using SVN?

thanks
asankha

asankha almost 17 years ago

Hi Jason

I am hoping/waiting to hear from good news from your side on this issue.. have you had any luck with the latest Git?

thanks
asankha

asankha over 16 years ago

I'd just like to drop something in:

asankha, please remember that Ohloh is still a free (as in free beer ;)) service. I think we all should have no claims or wishes that the Ohloh staff needs to do ASAP. Just waiting for an answer is enough - The Ohloh boys and girls will work on your issue once they have fixed more important things.

Lennart Koopmann over 16 years ago

Hi Lennart

I appreciate that Ohloh is still a free service.. but for whom? Anyone at Ohloh wouldn't possibly expect other open source - and of course free software projects - which after all makes up ohloh - to pay to get listed?

You may notice if you look carefully that many other open source projects (including many at ASF) are affected by this not so important issue to you..

However, I cannot figure out why you wanted to make this comment - when AFAIK you are not one of the core engineers of Ohloh.. and you clearly misunderstood my note to Jason (the chief geek at Ohloh) if you thought that I asked the Ohloh staff to do this enhancement ASAP.. ??

asankha

asankha over 16 years ago

Jason

Is the code that drives Ohloh code stats open source? Just wondering if I could be of any help to fix this issue..

thanks
asankha

asankha over 16 years ago

Jason

The Synapse repo is now available in read-only mode on Git at http://jukka.zitting.name/git/?p=synapse.git;a=summary

What will it now require for the enlistment to get the correct history? I am a newbie to Git, so appreciate if someone could help me here..

thanks
asankha

asankha over 16 years ago