upload image

Database errors project (October 30 2016)

Privacy Level: Open (White)
Date: 30 Oct 2016 to 6 Nov 2016
Location: Worldwidemap
Surname/tag: data_doctors
This page has been accessed 823 times.

Categories: DD Suggestions.

This page is part of the Data Doctors Project.
Latest report: February 17th 2019 and the Spreadsheet.
Custom reports by: Suggestion lists, Unsourced lists, Unconnected lists.
See WikiTree+ for custom reports and statistics.
Data Doctors Challenge: Names_VIII .
Category suggestion report: Latest report

Analysis was done on data from October 30th 2016.

Related post.

Here are pages of errors lists with basic person data and links to WikiTree.

Contents

News

New errors 822 Heading doesn't end with =, 823 Heading doesn't start with =, 824 Heading different number of = and 825 Use separator line - - - -

Added a few errors to further validate captions.

800 errors update

New biography dump is here so here are updates to the errors.

1663604 Errors Total 0000-0000 0001-1499 1500-1699 1700-1799 1800-1899 1900-1999 2000-Now Now-9999 Open New
801 Big profile 275 3 1 11 117 143 191 2
802 Empty profile 85659 35534 1061 1789 6523 29445 11235 72 42348 876
803 Almost empty profile 16676 3614 659 790 2060 6388 3151 14 11482 706
811 Uncleaned profile after merge 201444 13622 7542 30388 44011 79120 26634 127 148697 4520
821 Headings starts with blank 2855 34 51 348 600 1519 303 2591 280
822 Heading doesn't end with = 15309 403 739 1865 2885 7395 2017 5 13246 15309
823 Heading doesn't start with = 17963 894 253 921 2539 10975 2377 4 14693 17963
824 Heading different number of = 4085 139 108 491 870 1915 562 3490 4085
825 Use separator line ---- 2083 40 8 150 403 1288 194 1793 2083
831 Multiple duplicated lines 101465 2982 2324 6722 11303 64837 13289 8 68081 5978

Previous news

New Error 831 831 Multiple duplicated lines

This error is added if whole line is repeated in biography. Line must be at least 40 letters long to be checked. Number of all repeated lines must be more than 10 to be an error. There are also some texts I excluded from checking (Lines beginning with :: Place:, :: Relationship to, Detail:(No detail, and Citation provides evidence for). I can add more if you think it is needed. In future we might make this rules more strict. I excluded profiles with error 811.

Updated 6x1 Wrong word in x location

I added Unicode errors for few Norwegian places (H2land, S2r, S2rum, Str2m, Tr2gstad), also added Age, Aged, Alive, HTTP and HTTPS as forbidden words. Unknown is also still checked with spelling variations. If you notice any other wrong words in Location field, let me know.

Updated 6x5 Number in x location

I corrected algorithm to ignore some separators so also dates (01/02/2000, 01-10-2011) are added to error.

Updated 104 Too old

I changed maximum allowed age from 115 to 110 years. I also automatically exclude profiles, that are in Centenarians or Supercentenarians category. So don't use False error. Add appropriate category. I will probably remove False error in the future. I will also lover the age to 100 in the future.

New 6x8 Misspelled country

I am checking for spelling of list of known countries. Country is entered as last word or words in location field. I prepared a list back in april, to identify location to a country. There are local and english version of a country. I added also some common variations like USA, United stated, United states of America, I also added some cities or regions without the country like Amsterdam, Derbyshire, Connecticut. When correcting those, you can of course also add the country. Some disambiguous misspelling will have two errors Like austraia could be Australia or Austria. List contains cca 450 names. If you find any errors in report, let me know. I expect there are some. I didn't expect that many errors, but here they are.

Errors

Analysis was done on data from October 30th 2016.

1554732 Errors Total 0000-0000 0001-1499 1500-1699 1700-1799 1800-1899 1900-1999 2000-Now Now-9999 Open New
101 Birth in future 56 56
102 Death in future 79 7 67 5 3 6
103 Death before birth 12004 19 514 1315 5630 4453 73 9289 8
104 Too old 7986 291 1414 2624 3505 148 4 7326 26
105 Duplicate sibling 624 28 71 269 256 416 49
106 Duplicates between global tree and unconnected 794 1 142 249 303 99 631 72
107 Full name in UPPERCASE 1752 861 4 1 324 545 17 30 1
108 Full name in lowercase 2740 2467 4 40 222 7 2
109 Profile should be open (birth date) 13253 4 13 1636 11600 77
110 Profile should be open (death date) 921 241 9 71 365 233 2 29
111 Died too young to be parent 485 35 58 55 191 138 8 369
112 Person is Father and mother 609 92 5 9 79 310 114 272 12
201 Father is self 91 58 21 12 1 1
202 Parents are same 66 8 2 25 31 14 3
203 Father is Female 4414 674 20 159 727 2315 519 3102 57
204 Father has no Gender 559 399 4 139 17 19 20
205 Father is too young or not born 38937 1923 4022 8137 17794 6972 75 14 32805 119
206 Father is too old 5620 405 1193 2097 1919 6 5286 8
207 Father is also a child 167 63 14 6 13 54 17 59 8
208 Father is also a spouse 30 5 3 1 3 18 11
209 Father is also a sibling 1453 281 96 132 93 700 151 823 32
210 Father was dead before birth 38479 1581 2553 7231 11304 15039 771 35366 132
211 Duplicate sibling by father 1328 2 120 300 788 118 922 22
212 Profile should be open (Child birth date) 4255 4255 23
303 Mother is Male 4955 595 54 223 852 2721 510 3483 48
304 Mother has no Gender 601 491 8 82 20 41 26
305 Mother too young or not born 49875 2402 5425 11526 22849 7596 76 1 42696 173
306 Mother is too old 4597 281 902 1615 1793 6 4276 5
307 Mother is also a child 3 1 1 1 1 1
308 Mother is also a spouse 293 68 47 20 40 108 10 146 16
309 Mother is also a sibling 109 22 1 1 4 65 16 38 1
310 Mother was dead before birth 43157 1946 1850 8383 13493 16709 775 1 39708 135
311 Duplicate sibling by mother 389 4 32 67 230 56 246 5
312 Profile should be open (Child birth date) 3838 3838 32
401 Spouse is self 2 1 1
402 Unknown gender of spouse 731 489 8 201 33 39 35
403 Single sex marriage 1222 244 13 29 30 811 95 573 45
404 Marriage before birth 8787 198 798 1903 4253 1634 1 7479 38
405 Married too old 2140 54 292 623 1171 1929 5
406 Marriage after death 11239 470 329 1652 2795 5590 403 9968 39
407 Lived too long after marriage 419 10 11 61 122 187 28 321 9
408 Multiple marriages on same day 3879 410 6 471 1051 1810 131 3213 71
409 Marriage to duplicate person 12197 2935 105 1145 2473 5118 421 9359 222
501 Wrong gender (male) 4346 946 13 39 576 2396 374 2 2371 91
502 Missing gender (male) 55663 40778 1 18 7818 7030 17 1 7259 362
503 Probably wrong gender (male) 4958 1264 45 438 599 2015 587 10 3104 56
504 Missing gender (probably male) 28868 24802 1 82 1115 2826 42 758 243
505 Wrong gender (female) 6108 1163 3 169 412 3850 508 3 3847 49
506 Missing gender (female) 40568 31457 12 3439 5648 12 3343 351
507 Probably wrong gender (female) 4766 793 20 201 639 2040 1071 2 3196 43
508 Missing gender (probably female) 26592 21543 4 16 299 2476 2234 20 2579 245
509 Missing gender 101388 89069 18 324 1029 5442 5459 47 10152 824
510 Unique name without gender 20631 11231 10 131 323 4878 4002 56 7233 94
511 Unique names (spelling) 259258 48441 7638 12311 19877 98031 71436 1523 1 149314 1526
551 Wikidata - Missing gender 38 4 34
552 Wikidata - Different gender 6 2 4 1
553 Wikidata - Empty birth date 256 256 236 9
554 Wikidata - Imprecise birth date 983 136 204 203 355 85 915 6
555 Wikidata - Different birth date 3464 1695 789 384 454 141 1 3395 93
556 Wikidata - Empty death date 308 116 57 29 24 48 34 267 11
557 Wikidata - Imprecise death date 1173 33 257 229 214 355 85 1106 6
558 Wikidata - Different death date 3823 76 2306 611 323 409 98 3778 92
559 Wikidata - Missing birth location 1859 47 241 417 386 588 180 1770 15
561 Wikidata - Missing death location 2301 80 415 423 437 708 238 2216 13
601 Wrong word in birth location 7908 917 153 1214 4436 1188 5981 19
604 Birth location too short 7209 1043 42 905 970 3608 641 3772 55
605 Number in birth location 535 339 174 22 12 12
606 Bogus birth location 5 1 4 2 1
607 Misspelled word in birth location 10681 176 193 1704 3265 4738 605 9210 81
608 Misspelled country in birth location 20623 346 180 1189 3822 12617 2469 17057 129
631 Wrong word in death location 20362 803 2 198 3319 13061 2979 17386 76
632 Y death location 1082 14 993 75
634 Death location too short 8141 691 133 713 1245 4466 893 4790 47
635 Number in death location 345 71 2 231 41 15 13
636 Bogus death location 600 3 6 215 239 136 1 574 1
637 Misspelled word in death location 4357 113 5 736 1224 1687 592 3561 56
638 Misspelled country in death location 12318 400 92 595 2305 6893 2033 10126 110
661 Wrong word in marriage location 1414 43 44 305 770 252 1116 5
664 Marriage location too short 2413 187 1 303 507 1302 113 1686 12
665 Number in marriage location 99 53 34 12 4 2
667 Misspelled word in marriage location 1245 5 13 569 642 16 1032 14
668 Misspelled country in marriage location 3701 127 19 220 937 2114 284 3119 23
711 Separators in Prefix 1030 80 9 66 34 475 365 1 447 2
712 Number in Prefix 1102 37 9 81 832 143 892
713 Suffix in Prefix 2039 239 19 20 51 779 929 2 805 32
714 Wrong word in Prefix 924 236 3 6 59 306 290 24 448 2
721 Separators in First Name 48094 8015 239 2096 5609 26627 5508 31783 127
722 Number in First Name 92 83 2 7 16
723 Prefix in First Name 23726 6082 2128 2757 4025 7103 1629 2 18444 49
724 Wrong word in First Name 7691 2000 79 407 821 2942 1441 1 5323 32
731 Separators in Preferred Name 14665 2385 74 76 101 1789 10173 67 692 39
732 Number in Preferred Name 37 30 1 6
733 Prefix in Preferred Name 7047 1556 221 218 266 795 3930 61 1486 40
734 Wrong word in Preferred Name 1803 550 6 17 15 121 1076 18 160 16
741 Separators in Middle Name 1326 101 1 66 96 802 260 971 8
742 Number in Middle Name 8 1 7
743 Prefix in Middle Name 2882 155 39 64 273 1813 538 2441 17
744 Wrong word in Middle Name 874 112 3 25 140 465 128 1 739 21
751 Separators in Nicknames 2619 107 328 293 325 1231 334 1 2281 30
752 Number in Nicknames 144 4 2 34 104 92
753 Prefix in Nicknames 3166 279 867 460 533 698 329 2952 15
754 Wrong word in Nicknames 1004 80 64 87 94 505 174 861 4
761 Separators in Suffix 7699 1196 180 972 1657 2337 1349 8 5261 28
762 Number in Suffix 1445 283 126 399 440 196 1 1025 7
763 Prefix in Suffix 8690 967 186 485 986 2040 4010 16 3353 47
764 Wrong word in Suffix 1312 86 3 142 148 478 449 6 663 8
771 Separators in Last Name at Birth 4862 836 78 812 1180 1349 599 8 3222 12
772 Number in Last Name at Birth 10 10
773 Prefix in Last Name at Birth 15 5 2 2 6 4
774 Wrong word in Last Name at Birth 13 6 5 1 1 13
781 Separators in Current Last Name 6511 1254 112 839 1235 1897 1166 8 4096 22
782 Number in Current Last Name 10 10
783 Prefix in Current Last Name 14 5 1 8
784 Wrong word in Current Last Name 265 38 41 105 40 24 17 254
791 Separators in Last Name Other 4657 260 194 875 1050 1169 1106 2 1 3285 24
792 Number in Last Name Other 9 3 1 5 1
794 Wrong word in Last Name Other 504 76 25 91 65 121 124 2 333 6
801 Big profile 275 3 11 120 141 192
802 Empty profile 83767 34561 1054 1728 6346 29031 10975 72 40942
803 Almost empty profile 15656 3381 630 729 1884 6081 2938 13 10660
811 Uncleaned profile after merge 190579 13220 7314 28739 41456 75138 24589 123 140166
821 Headings starts with blank 2544 30 47 293 517 1401 256 2300
831 Multiple duplicated lines 71995 1347 554 2926 6951 50592 9625 47361
901 Unconnected empty public profiles 35539 35539 20
902 Unconnected empty open profiles 18174 18174 18174 230
911 Swedish patronym DOTTER for male 7 1 2 4 6
912 Swedish patronym SSON for female 935 1 20 80 518 316 856 2

Changes since previous update

Detailed statistics are available on http://wikitree.sdms.si/default.htm in Statistics section.







Collaboration

On 31 Oct 2016 at 22:41 GMT Carol (Winton) Keeling wrote:

Worked on error 637 (misspelled word in death location), all last week and managed to reduce the total by just over 1,000 errors. Hoping to do the same this week.

On 31 Oct 2016 at 21:52 GMT Paula (Round) Dea wrote:

31-Oct-16 +
  • 667 - New - done
  • 667 - 0000 - done previously
  • 667 - 1500 - done previously
  • 667 - 1900 - done previously