upload image

Database errors project (29 May 2016)

Privacy Level: Open (White)
Date: 29 May 2016 to 5 Jun 2016
Location: Worldwidemap
Surname/tag: data_doctors
This page has been accessed 1,041 times.

Categories: DD Suggestions.

This page is part of the Data Doctors Project.
Latest report: February 10th 2019 and the Spreadsheet.
Custom reports by: Suggestion lists, Unsourced lists, Unconnected lists.
See WikiTree+ for custom reports and statistics.
Data Doctors Challenge: Dates_VIII .

Analysis was done on data from May 29nd 2016.

Related post.

Here are pages of errors lists with basic person data and links to WikiTree.

Contents

News

New errors: 606, 636, 666 Bogus location

606, 636, 666 Bogus location: This location is inserted as location by autocomplete operations of some softwares or websites.

1186712 Errors Total 0000-0000 0001-1499 1500-1699 1700-1799 1800-1899 1900-1999 2000-Now Now-9999
606 Bogus birth location 58 10 4 31 5 8
636 Bogus death location 980 45 178 288 327 141 1

Refined date conditions

Now i correctly compare all uncomplete dates (Decade with private profiles, Year without month and day and Year and month without day) so there are no longer false errors with error 101, 102, 103, 104, 109, 110, 205, 206, 210, 305, 306, 310, 404-407 so number of errors slightly changed for these errors.

Error 511

Error 511 was tuned up to have less false errors.

Errors

Analysis was done on data from May 29th 2016.

1161991 Errors Total 0000-0000 0001-1499 1500-1699 1700-1799 1800-1899 1900-1999 2000-Now Now-9999
101 Birth in future 242 242
102 Death in future 307 2 63 234 5 3
103 Death before birth 14152 130 592 1528 6524 5190 143 45
104 Too old 6621 430 1193 1985 2868 140 4 1
105 Duplicate sibling 2687 2 10 560 1364 751
106 Duplicates between global tree and unconnected 2789 20 381 908 1321 159
107 Full name in UPPERCASE 3089 1983 45 60 378 606 17
108 Full name in lowercase 3194 2901 1 6 48 231 7
109 Profile should be open (birth date) 18738 7 406 190 3160 14975
110 Profile should be open (death date) 1664 754 4 72 151 436 245 2
201 Father is self 112 59 10 1 28 14
202 Parents are same 79 7 40 32
203 Father is Female 6376 869 31 312 1105 3600 459
204 Father has no Gender 954 446 2 1 464 41
205 Father is too young or not born 42740 2048 4584 9231 19151 7606 90 30
206 Father is too old 6648 523 1498 2383 2210 34
207 Father is also a child 375 81 27 33 94 120 20
208 Father is also a spouse 208 11 6 13 25 141 12
209 Father is also a sibling 2967 371 115 257 607 1327 290
210 Father was dead before birth 42118 1674 2673 8445 12406 16044 876
301 Mother is self 8 5 3
303 Mother is Male 7333 675 65 311 1292 4526 464
304 Mother has no Gender 1074 751 4 273 46
305 Mother too young or not born 54347 2490 6158 12901 24402 8289 91 16
306 Mother is too old 5606 427 1171 1905 2070 33
307 Mother is also a child 12 1 2 5 4
308 Mother is also a spouse 1186 129 63 68 272 594 60
309 Mother is also a sibling 351 53 7 9 48 196 38
310 Mother was dead before birth 48175 2153 1961 10188 14909 18022 940 2
401 Spouse is self 2 1 1
402 Unknown gender of spouse 1742 675 6 13 960 88
403 Single sex marriage 2156 271 80 35 80 1544 146
404 Marriage before birth 11152 215 966 2405 5428 2113 21 4
405 Married too old 2760 123 427 759 1445 6
406 Marriage after death 13271 574 371 2049 3227 6388 662
407 Lived too long after marriage 1583 39 17 193 332 813 189
408 Multiple marriages on same day 10011 265 5 1652 2986 4740 363
409 Marriage to duplicate person 31338 4070 313 4089 7917 13328 1619 2
501 Wrong male gender 8515 1450 12 668 1335 3853 1194 3
502 Missing male gender 74330 37797 11 993 5744 20872 8883 29 1
503 Probably wrong male gender 6389 1348 60 546 713 2377 1334 10 1
504 Missing probably male gender 36393 24679 8 38 887 5504 5235 42
505 Wrong female gender 9699 1498 30 477 1399 5030 1263 2
506 Missing female gender 59697 29216 52 605 4448 18740 6618 17 1
507 Probably wrong female gender 5575 919 22 237 715 2517 1163 2
508 Missing probably female gender 30243 20724 9 147 640 4669 4034 19 1
509 Missing gender 95072 79707 40 403 1412 7146 6309 53 2
510 Unique name without gender 23373 10809 50 176 700 6991 4578 69
511 Unique first name (spelling) 293826 52188 6740 13072 23234 118191 78822 1570 9
512 Separators in first name 68177 11615 365 2537 6563 31051 16002 44
601 Unknown birth location 9003 1686 2 361 1349 4242 1361 2
604 Birth location too short 13796 1804 83 976 2165 7293 1475
605 Number in birth location 1764 980 8 57 166 532 21
631 Unknown death location 16198 1418 1 771 2568 9204 2236
632 Y death location 5662 60 10 10 454 5041 87
634 Death location too short 16033 1023 219 939 2342 10277 1233
635 Number in death location 1239 206 5 126 302 536 64
661 Unknown marriage location 1350 69 65 235 748 233
664 Marriage location too short 2802 214 14 336 580 1424 234
665 Number in marriage location 11 11
901 Unconnected empty public profiles 35432 35432
902 Unconnected empty open profiles 17235 17235

Changes since previous update

Explanation of error changes:

  • Increase in persons profiles was 0.44% so all errors should increase for that amount. that is 3877 errors. Error 511 is excluded, since algorithm changed and cannot be compared.
  • and there are 10904 fewer errors

So in 7 days 14781 errors were corrected by my estimation.

Note: Usually with one correction you can correct multiple errors, because errors repeat in different groups.

1.5. 11.5. 15.5. 22.5. Projected 29.5. Reduction Delta%
Profiles 11184648 11206469 11262275 11311734 100,439%
Locations 10707022 10732026 10798925 10853793 100,508%
Father 6015213 6045514 6072066 100,439%
Mother 5661601 5689774 5714594 100,436%
Marriages 2564629 2577987 2588736 100,417%
101 Birth in future 343 312 308 253 254 242 12 4,77%
102 Death in future 370 343 331 313 314 307 7 2,35%
103 Death before birth 13139 13111 13080 13022 13079 12774 305 2,33%
104 Too old 7021 7036 7001 6968 6999 6930 69 0,98%
105 Duplicate sibling 4711 3892 3607 3026 3039 2876 163 5,37%
106 Duplicates between bigtree and unconnected 3253 3293 3245 2959 2972 2791 181 6,09%
107 Full name in UPPERCASE 3153 3136 3150 3088 62 1,96%
108 Full name in lowercase 3207 3193 3207 3193 14 0,44%
109 Profile should be open (birth date) 11667 11439 11489 10853 636 5,54%
110 Profile should be open (death date) 1516 1512 1519 1481 38 2,48%
201 Father is self 251 240 121 114 115 112 3 2,18%
202 Parents are same 224 221 193 98 98 79 19 19,74%
203 Father is Female 6167 6244 6257 6253 6280 6376 -96 -1,52%
204 Father has no Gender 2159 1689 1175 1026 1031 954 77 7,42%
205 Father is too young or not born 48551 48867 48694 48607 48820 48653 167 0,34%
206 Father is too old 6952 6955 6928 6789 6819 6775 44 0,64%
207 Father is also a child 510 502 393 378 380 375 5 1,23%
208 Father is also a spouse 241 234 232 216 217 208 9 4,12%
209 Father is also a sibling 3527 3512 3236 3078 3092 2967 125 4,03%
210 Father was dead before birth 32482 32559 32505 32506 32649 32447 202 0,62%
301 Mother is self 10 6 5 5 5 8 -3 -59,31%
303 Mother is Male 8321 7931 7880 7798 7832 7333 499 6,37%
304 Mother has no Gender 2101 1856 1715 1540 1547 1074 473 30,56%
305 Mother too young or not born 65178 65596 65535 65559 65845 65553 292 0,44%
306 Mother is too old 5822 5817 5783 5716 5741 5685 56 0,97%
307 Mother is also a child 35 34 13 11 11 12 -1 -8,62%
308 Mother is also a spouse 1566 1578 1516 1322 1328 1186 142 10,68%
309 Mother is also a sibling 373 364 362 356 358 351 7 1,83%
310 Mother was dead before birth 31202 31224 31153 31067 31203 30892 311 1,00%
401 Spouse is self 4 3 3 3 3 2 1 33,61%
402 Unknown gender of spouse 2990 2538 2386 2068 2077 1742 335 16,11%
403 Single sex marriage 4671 4001 3998 3502 3517 2156 1361 38,69%
404 Marriage before birth 10937 10704 10634 10526 10570 10560 10 0,09%
405 Married too old 2857 2871 2847 2812 2824 2769 55 1,94%
406 Marriage after death 12580 12602 12556 12506 12558 12074 484 3,86%
407 Death too old after Marriage 2027 1818 1769 1659 1666 1605 61 3,66%
408 Multiple marriages on same day 10234 10198 10241 10011 230 2,24%
409 Marriage to duplicate person 31870 31772 31904 31338 566 1,78%
501 Wrong male gender 7130 7012 9064 8813 8852 8515 337 3,80%
502 Missing male gender 53397 53276 75402 74800 75128 74330 798 1,06%
503 Probably wrong male gender 8380 8349 6237 6147 6174 6389 -215 -3,48%
504 Probably missing male gender 56357 56486 36129 35644 35801 35693 108 0,30%
505 Wrong female gender 9072 8717 10479 10295 10340 9699 641 6,20%
506 Missing female gender 51058 51119 60682 60375 60640 59697 943 1,56%
507 Probably wrong female gender 7027 6946 5389 5260 5283 5575 -292 -5,53%
508 Probably missing female gender 37889 37983 29462 29382 29511 30243 -732 -2,48%
509 Missing gender 97415 97714 95747 96390 96813 95072 1741 1,80%
510 Unique name without gender 24792 24854 23654 23454 23557 23373 184 0,78%
511 Unique name (spelling) 476223 346225 283116 284359 293826 0 0,00%
512 Separators in first name 68680 68716 68383 68683 68177 506 0,74%
601 Unknown birth location 9291 9343 9366 9392 9440 9003 437 4,63%
604 Birth location too short 16791 13986 14057 13796 261 1,86%
605 Number in birth location 1933 1943 1764 179 9,20%
631 Unknown death location 16230 16454 16505 16509 16593 16198 395 2,38%
632 Y death location 6542 6534 6736 6355 6387 5662 725 11,36%
634 Death location too short 18242 17071 17158 16033 1125 6,56%
635 Number in death location 1625 1633 1239 394 24,14%
661 Unknown marriage location 1328 1350 1346 1348 1355 1350 5 0,36%
664 Marriage location too short 3246 3020 3035 2802 233 7,69%
665 Number in marriage location 228 229 11 218 95,20%
901 Unconected empty public profiles 35473 35433 35418 35346 35501 35432 69 0,19%
902 Unconected empty open profiles 17242 17221 17172 17136 17211 17235 -24 -0,14%
Total 719198 1261647 1229116 1159314 1164434,519 1159120 14955 1,27%






Collaboration

On 2 Jun 2016 at 07:20 GMT AleŇ° Trtnik wrote:

Doug, you probably mean error 106.

On 2 Jun 2016 at 06:16 GMT Doug Henderson wrote:

I looked at type 160 errors. I found a few that I could fix, but most had active profile managers so I proposed a merge with message:

detected by Database Errors Project Error: 160 Duplicates between global tree and unconnected

Some of these duplicates looked like they could easily be corrected with a moments cooperation between the profile managers. I think we should look at the GEDCOM import process to see if this cooperation can be achieved more easily so that the importer does not feel compelled to take the quick way past a delay by rejecting a clear and correct merge suggestion. The difficulty arises when the imported profile contains more or better extra information that the importer does not want to loose or when a well sourced profile should replace a hand entered one.

On 31 May 2016 at 13:16 GMT Jayme (Mullins) Arrington wrote:

Continuing to work on error 409, 0001-1499.

On 31 May 2016 at 01:25 GMT Paul Gierszewski wrote:

407 - too old after marriage. 0000 done or messaged. 0-1499 messaged. 1500-1599 in progress.

On 31 May 2016 at 00:59 GMT Nan Lambert wrote:

502 - missing male gender. 1700-1799 in progress.

On 30 May 2016 at 20:23 GMT Nan Lambert wrote:

304, mother has no gender - 1800-1899. Done, messages left on profiles not Open.

On 30 May 2016 at 17:12 GMT Mikey Anonymous wrote:

665 taken care of, PMs need to change some

405, 1900-1999, ditto

402, 1700-1799 done

106, 1500-1699 Virginia, partial

On 30 May 2016 at 16:45 GMT Nan Lambert wrote:

105 duplicate siblings, 1500-1699 -- done. All merges completed or proposed, with a very few exceptions of profiles with PPP and/or notices of pending research.

On 30 May 2016 at 16:44 GMT Nan Lambert wrote:

105 duplicate siblings, 0001-1499: complete for now, all merges proposed.

On 30 May 2016 at 16:00 GMT Pierre Goolaerts wrote:

Completed for errors with privacy 60:
  • all errors (Now-9999)
  • 103 (1900-1999)
  • 304 (1700-1800-1900-1999)
  • 606 (1500-1699) Reusel-de Mierden
  • working on 303 Mother is male (1900-1999), this has also a major effect on error 203.