Can someone help me make an Ahnentafel reconciliation?

+2 votes
71 views
Can anyone help make a complicated project page (from simple online data)?

I never went ahead with this idea, but I still think it is a good way to increase pre-1200 quality: https://www.wikitree.com/g2g/184281/any-interest-in-a-project-based-on-ancestry-henry-ii

I imagine three columns: the wikitree ahnentafel, the baldwin/farmerie one, and an editable reconciliation column for our editors to put notes in.

One reason is that I realized that the reconciliation really needs to have an automated page that updates as the two webpages being compared get changed. I always thought I would work out how to do this, but I have failed to do!

The two webpages to be lined up as two columns are:

1. Wikitree's Ahnentafel for Henry II: https://www.wikitree.com/treewidget/Plantagenet-1627/9

2. The Henry II website: http://home.earthlink.net/~henryproject/hproject/prov/at.htm

(The latter is the mirror website which has less problems.)
WikiTree profile: Henry II Plantagenet
asked in WikiTree Tech by Andrew Lancaster G2G6 Mach 5 (54.2k points)

1 Answer

+2 votes
It looks like it would be possible to scrape the data from the two webpages, but it would be a piece of drudge work writing the code to extract the names and other detail from the html. And it would have to be continually rerun as a batch process to capture the changes. If someone with a bit of experience had access to both the WikiTree and Henry Project databases, it would probably not be too difficult to achieve, and would be able to show changes in real time.
answered by Chris Hampson G2G6 Mach 8 (84.1k points)
Maybe it is important/useful to note that the Henry II website seems to have basically frozen their updates, so it is more or less fixed now. It is Wikitree which is the moving target.

Of course when you look at both pages in html they are very structured and repetitive.
For the WikiTree side, you shouldn't need to scrape the data from html pages... just use the weekly data dump which has much more structured data in json format.

or at a minimum, use the api calls to individual profiles (again, in json format)
Beyond me I'm afraid. Can anyone help?
I already have the Henry Project AT scraped.  I also have a basic scraper for WikiTree ATs, but I need to add renumbering to it, so that 6-generation chunks can be combined.

I doubt if updating is that big a deal.  Basically WikiTree fills gaps with questionable parents, which you might want to flag as Uncertain, or something.

Those lines continue further back.  The continuations might be good, or might not, but you don't get any help from Baldwin with that - once a line is pruned, it stays pruned.

So it looks like the updates would just be a matter of deleting any WikiTree parents that you might snip off, if you get reckless, and their ancestors.

Can't see that you'll be much troubled by other people's activities.  Nothing happening round here.

This is how the first 127 line up

{|border=1 cellpadding=2 class="wikitable sortable"
!  !!  !!  !!
|-
! AT#!!Henry Project!!WikiTree-ID!!Notes
|-
|1||[http://home.earthlink.net/~henryproject/hproject/prov/henry002.htm Henry]||[[Plantagenet-1627]]||
|-
|2||[http://home.earthlink.net/~henryproject/hproject/prov/geoff005.htm Geoffrey]||[[Anjou-7]]||
|-
|3||[http://home.earthlink.net/~henryproject/hproject/prov/matil002.htm Matilda]||[[Normandie-40]]||
|-
|4||[http://home.earthlink.net/~henryproject/hproject/prov/fulk0005.htm Foulques]||[[Anjou-34]]||
|-
|5||[http://home.earthlink.net/~henryproject/hproject/prov/eremb000.htm Eremburge]||[[Maine-29]]||
|-
|6||[http://home.earthlink.net/~henryproject/hproject/prov/henry001.htm Henry]||[[Normandie-45]]||
|-
|7||[http://home.earthlink.net/~henryproject/hproject/prov/matil001.htm Eadgyth/Matilda]||[[Dunkeld-79]]||
|-
|8||[http://home.earthlink.net/~henryproject/hproject/prov/fulk0004.htm Foulques]||[[Anjou-46]]||
|-
|9||[http://home.earthlink.net/~henryproject/hproject/prov/bertr000.htm Bertrade]||[[Montfort-11]]||
|-
|10||[http://home.earthlink.net/~henryproject/hproject/prov/helia000.htm Helias]||[[Maine-32]]||
|-
|11||[http://home.earthlink.net/~henryproject/hproject/prov/mathi001.htm Mathilde]||[[Château-du-Loire-11]]||
|-
|12||[http://home.earthlink.net/~henryproject/hproject/prov/willi001.htm William]||[[Normandie-32]]||
|-
|13||[http://home.earthlink.net/~henryproject/hproject/prov/matil000.htm Matilda]||[[Flandre-3]]||
|-
|14||[http://home.earthlink.net/~henryproject/hproject/prov/malco002.htm Malcolm]||[[Dunkeld-77]]||
|-
|15||[http://home.earthlink.net/~henryproject/hproject/prov/marga000.htm St. Margaret]||[[Wessex-26]]||
|-
|16||[http://home.earthlink.net/~henryproject/hproject/prov/geoff002.htm Geoffrey]||[[Perche-31]]||
|-
|17||[http://home.earthlink.net/~henryproject/hproject/prov/ermen001.htm Ermengarde]||[[Anjou-3]]||
|-
|18||[http://home.earthlink.net/~henryproject/hproject/prov/simon000.htm Simon]||[[Montfort-9]]||
|-
|19||[http://home.earthlink.net/~henryproject/hproject/prov/agnes000.htm Agnes]||[[Evreux-1]]||
|-
|20||[http://home.earthlink.net/~henryproject/hproject/prov/john0000.htm Jean]||[[Beaugency-7]]||
|-
|21||[http://home.earthlink.net/~henryproject/hproject/prov/paula000.htm Paula]||[[Maine-34]]||
|-
|22||[http://home.earthlink.net/~henryproject/hproject/prov/gerva000.htm Gervaise]||[[Château-du-Loire-10]]||
|-
|23||[http://home.earthlink.net/~henryproject/hproject/prov/eremb001.htm Éremburge]||[[Unknown-298581]]||
|-
|24||[http://home.earthlink.net/~henryproject/hproject/prov/rober000.htm Robert]||[[Normandie-43]]||
|-
|25||Herleve||[[Falaise-2]]||
|-
|26||[http://home.earthlink.net/~henryproject/hproject/prov/baldw005.htm Baldwin]||[[Flandre-7]]||
|-
|27||[http://home.earthlink.net/~henryproject/hproject/prov/adele002.htm Adèle]||[[Capet-24]]||
|-
|28||[http://home.earthlink.net/~henryproject/hproject/prov/dunca001.htm Duncan]||[[Dunkeld-8]]||
|-
|29||[http://home.earthlink.net/~henryproject/hproject/prov/suthe000.htm Suthen]||[[Unknown-275536]]||
|-
|30||[http://home.earthlink.net/~henryproject/hproject/prov/edwar000.htm Eadweard]||[[Wessex-347]]||
|-
|31||[http://home.earthlink.net/~henryproject/hproject/prov/agath000.htm Agatha]||[[Unknown-59030]]||
|-
|32||[http://home.earthlink.net/~henryproject/hproject/prov/hugh0006.htm Hughes]||[[Perche-28]]||
|-
|33||[http://home.earthlink.net/~henryproject/hproject/prov/beatr000.htm Beatrix]||[[Mâcon-54]]||
|-
|34||[http://home.earthlink.net/~henryproject/hproject/prov/fulk0003.htm Foulques]||[[Anjou-69]]||
|-
|35||Hildegarde||[[Metz-538]]||
|-
|36||[http://home.earthlink.net/~henryproject/hproject/prov/amaur000.htm Amaury]||[[Montfort-29]]||
|-
|37||Bertrade||[[Gometz-1]]||
|-
|38||[http://home.earthlink.net/~henryproject/hproject/prov/richa002.htm Richard]||[[Evreux-32]]||
|-
|39||[http://home.earthlink.net/~henryproject/hproject/prov/godeh000.htm Godehilde]||[[Barcelona-100]]||
|-
|40||[http://home.earthlink.net/~henryproject/hproject/prov/lance000.htm Landry]||[[Beaugency-4]]||
|-
|41||    ||[[UNKNOWN-45325]]||
|-
|42||    ||[[Maine-30]]||
|-
|43||    ||[[Blois-16]]||
|-
|44||[http://home.earthlink.net/~henryproject/hproject/prov/rober002.htm Robert]||[[Château-du-Loire-3]]||
|-
|45||[http://home.earthlink.net/~henryproject/hproject/prov/eliza000.htm Elizabeth]||[[Vergy-6]]||
|-
|47||[http://home.earthlink.net/~henryproject/hproject/prov/mathi002.htm Mathilde]||[[UNKNOWN-48624]]||
|-
|48||[http://home.earthlink.net/~henryproject/hproject/prov/richa001.htm Richard]||[[Normandie-36]]||
|-
|49||[http://home.earthlink.net/~henryproject/hproject/prov/judit001.htm Judith]||[[Bretagne-24]]||
|-
|50||Fulbert||[[Falaise-8]]||
|-
|52||[http://home.earthlink.net/~henryproject/hproject/prov/baldw004.htm Baldwin]||[[Flandre-36]]||
|-
|53||[http://home.earthlink.net/~henryproject/hproject/prov/otgiv000.htm Otgive]||[[Luxembourg-9]]||
|-
|54||[http://home.earthlink.net/~henryproject/hproject/prov/rober102.htm Robert]||[[Capet-41]]||
|-
|55||[http://home.earthlink.net/~henryproject/hproject/prov/const000.htm Constance]||[[Arles-8]]||
|-
|56||[http://home.earthlink.net/~henryproject/hproject/prov/crina000.htm Crinan]||[[Dunkeld-9]]||
|-
|57||[http://home.earthlink.net/~henryproject/hproject/prov/betho000.htm Bethoc]||[[MacAlpin-33]]||
|-
|60||[http://home.earthlink.net/~henryproject/hproject/prov/edmun002.htm Eadmund]||[[Wessex-28]]||
|-
|61||[http://home.earthlink.net/~henryproject/hproject/prov/ealdg000.htm Ealdgyth]||[[Unknown-381585]]||
|-
|64||[http://home.earthlink.net/~henryproject/hproject/prov/fulco000.htm Fulcois]||[[De_Nogent-4]]||
|-
|65||[http://home.earthlink.net/~henryproject/hproject/prov/melis000.htm Melisende]||[[Unknown-213857]]||
|-
|66||[http://home.earthlink.net/~henryproject/hproject/prov/aubry002.htm Aubry]||[[Mâcon-47]]||
|-
|67||[http://home.earthlink.net/~henryproject/hproject/prov/ermen101.htm Ermentrude]||[[Roucy-1]]||
|-
|68||[http://home.earthlink.net/~henryproject/hproject/prov/geoff001.htm Geoffroy]||[[Anjou-20]]||
|-
|69||[http://home.earthlink.net/~henryproject/hproject/prov/adele001.htm Adèle]||[[Vermandois-351]]||
|-
|70||    ||[[Metz-160]]||
|-
|71||    ||[[Unknown-324610]]||
|-
|72||    ||[[Hainaut-54]]||
|-
|73||    ||[[Esperon-2]]||
|-
|74||    ||[[Gometz-8]]||
|-
|76||[http://home.earthlink.net/~henryproject/hproject/prov/rober001.htm Robert]||[[Normandie-61]]||
|-
|77||[http://home.earthlink.net/~henryproject/hproject/prov/herle001.htm Herleve]||[[UNKNOWN-33812]]||
|-
|78||    ||[[Sunifred-4]]||
|-
|79||    ||[[Carcassonne-5]]||
|-
|80||[http://home.earthlink.net/~henryproject/hproject/prov/lande000.htm Landry]||[[Beaugency-3]]||
|-
|84||    ||[[Maine-4]]||
|-
|85||    ||[[Unknown-322841]]||
|-
|86||    ||[[Blois-42]]||
|-
|87||    ||[[Auvergne-68]]||
|-
|88||[http://home.earthlink.net/~henryproject/hproject/prov/hamon000.htm Hamon/Hamelin]||[[Château-du-Loire-2]]||
|-
|89||[http://home.earthlink.net/~henryproject/hproject/prov/hilde000.htm Hildeburge]||[[Bellême-9]]||
|-
|90||    ||[[Vergy-8]]||
|-
|91||    ||[[Chalon-68]]||
|-
|96||[http://home.earthlink.net/~henryproject/hproject/prov/richa000.htm Richard]||[[Normandie-30]]||
|-
|97||Gunnor||[[Crépon-79]]||
|-
|98||[http://home.earthlink.net/~henryproject/hproject/prov/conan000.htm Conan]||[[Rennes-22]]||
|-
|99||[http://home.earthlink.net/~henryproject/hproject/prov/ermen000.htm Ermengarde]||[[Anjou-2]]||
|-
|104||[http://home.earthlink.net/~henryproject/hproject/prov/arnul001.htm Arnulf]||[[Flandre-9]]||
|-
|105||Rozala||[[Ivrea-7]]||
|-
|106||    ||[[Luxembourg-1]]||
|-
|107||    ||[[Gleiberg-4]]||
|-
|108||[http://home.earthlink.net/~henryproject/hproject/prov/hugh1002.htm Hugues]||[[Capet-57]]||
|-
|109||[http://home.earthlink.net/~henryproject/hproject/prov/adela002.htm Adelaide]||[[Poitou-14]]||
|-
|110||[http://home.earthlink.net/~henryproject/hproject/prov/willi002.htm Guillaume]||[[Arles-48]]||
|-
|111||[http://home.earthlink.net/~henryproject/hproject/prov/adela000.htm Adélaïde]||[[Anjou-1]]||
|-
|112||    ||[[Dunkeld-86]]||
|-
|113||    ||[[Dunbar-165]]||
|-
|114||[http://home.earthlink.net/~henryproject/hproject/prov/malco001.htm Malcolm]||[[MacAlpin-34]]||
|-
|115||    ||[[Ossory-14]]||
|-
|120||[http://home.earthlink.net/~henryproject/hproject/prov/aethe002.htm Æthelred]||[[Wessex-29]]||
|-
|121||[http://home.earthlink.net/~henryproject/hproject/prov/aelfg002.htm Ælfgifu]||[[Northumbria-66]]||
|-
|122||    ||[[Mercia-61]]||
|}

That's about 30% of the whole HP AT.
Not very attractive here in G2G, but sounds interesting! Concerning your doubts about how to handle the problems that is why I suggest a third column we can edit.

doable?
Should we try putting it on a project page RJ? Or do you think this is not worth it?
You could make a page.  I'm piecing together extensions to see how it looks further back.  There'll be more junk on the WikiTree side but I don't know how much.

Longer version here

https://www.wikitree.com/wiki/Category:Horace-19_Todo#Long_version

If you copy it to another page, it'll start with a clean history.

About 120 "uncertain" parents, mostly wives and mothers.  No box left unfilled with speculation.

The Henry Project has about 40 other profiles which aren't in the AT, but they're all closely connected to it, or falsely closely connected.  FWIW I've added a table of those.

In the main table, a mismatch - WikiTree equates Billung's wife Aeda #3475 with Charlemagne's granddaughter Adelaide.  But Baldwin says the source is a fabrication and the connection is impossible anyway.

https://www.wikitree.com/wiki/Carolingian-170

Great! Now I just need to find a moment!

Related questions

+5 votes
2 answers
+3 votes
1 answer
50 views asked Aug 20 in Genealogy Help by C. Mackinnon G2G6 Mach 8 (87.5k points)
+3 votes
0 answers
+3 votes
1 answer

WikiTree  ~  About  ~  Help Help  ~  Search Person Search  ~  Surname:

disclaimer - terms - copyright

...