Wednesday, November 6, 2019

Forget Paper. Forget Hard Drives. Forget CD and DVD Disks....Use...Glass

Forget Paper. Forget Hard Drives. Forget CD and DVD Disks. Forget Most Everything Else. For Long-Term preservation, Use a Piece of Glass.

Genealogists frequently discuss the best ways to preserve family tree information so that it can be read and perhaps updated by future generations. Some people plan to save everything on paper so that “it won’t become obsolete.” Of course, they forget that paper is probably the most fragile storage medium of all, easily destroyed by water, humidity, acids in the paper, fire, insects, and a variety of other dangers.
Probably the greatest threat to data storage on paper is simply fading ink. Most paper prepared with today’s paper and today’s inks will be unreadable within a century, perhaps much less time than that.
Floppy disks were the storage medium of choice for some number of years ago but have since fallen into disfavor. The magnetic information of floppy disks doesn’t last forever. Even worse, floppy disk drives are rapidly disappearing. Most of us doubt that there will be any floppy disk drives available to read the disks within the next decade or two.
A better(?) solution is to record the information on CD-ROM or DVD-ROM disks but that has similar problems. These plastic disks also do not last forever, especially those that are recorded individually on today’s computers.

(CD and DVD disks manufactured in factories do preserve the information for many more years than those made individually on a home computer. You can read my earlier articles at https://blog.eogn.com/2016/05/24/your-cd-collection-is-dying/ and at https://blog.eogn.com/2017/07/31/the-demise-of-cds-and-dvds/ for more information.)
Several newer technologies hold a lot of promise but are not yet in widespread use. One that looks especially promising is a new storage medium optimized for what industry insiders like to call cold data — the type of data you likely won’t need to access for months, years, or even decades. It’s data that doesn’t need to sit on a server, ready to be used 24/7, but that is kept in a vault, away from anything that could corrupt it.
The new technology is called “Project Silica.”

A piece of silica glass measuring 7.5 centimeters (3 inches) by 7.5 centimeters (3 inches) by 2 centimeters (0.8 inches) can store at least 75.6 gigabytes of data, photographs, music, or even high-resolution videos.
The movie industry has many thousands of films that need preservation but also keep bumping up the limitations of today’s storage methods as do genealogists. For instance, the Warner Brothers studio has been safekeeping original celluloid film reels starting in the 1920s, audio from 1940s radio shows and much more, for decades. Think about classics like “Casablanca,” “The Wizard of Oz” or “Looney Tunes” cartoons: how can they be preserved?
Together, Warner Brothers and Microsoft have developed a solution to preserve those original assets in perpetuity. The new technology is first being used to store a copy of the 1978 movie “Superman” on a small glass disc about the size of a coaster. If successful, the same technology should be useful for storing family history information as well as for thousands of other uses.
You can read more about this technology in an article by Janko Roettgers in the Variety web site at: https://variety.com/2019/film/news/project-silica-superman-warner-bros-microsoft-1203390459/.
Of course, two present limitations might remain even in the future:
1. Will any devices capable of reading “Project Silica” glass still be available a few thousand years from now?
2. Will anyone a few thousand years from now have any interest in a very old “Superman” movie or even Looney Tunes?
My thanks to newsletter reader Pierre Clouthier for telling me about this latest technology.

4 Comments

If one is just printing black on paper and uses pigment ink it will not fade. it will outlast the paper.
Like
    Would you provide more information re: printing with pigment ink. Is this ink available for use in home printers?
    Thank you.
    Like
And when the glass breaks?
Like
—> And when the glass breaks?
Exactly the same thing as happens when a hard drive fails or a magnetic disk loses magnetism or a piece of paper is damaged or destroyed by any number of problems: it becomes useless.
That is the reason why I have written many times about the reason you want to ALWAYS create two (or preferably more than two) copies of everything that is important to you and then store them in two (or preferably more than two) locations. In fact, I store my important files in three or four locations and I wouldn’t be surprised if some people store things in ten or more locations. Those widely-separated multiple copies won’t all go bad at once if you have a good backup plan.
Regardless of the storage media used, every manager of every significant data center never depends upon only one copy of anything that is important. Individual consumers can learn a lot from data center managers.
L.O.C.K.S.S. – “Lots of Copies Keeps Stuff Safe”
See https://duckduckgo.com/?ratb=c&q=site%3Aeogn.com+%22L.O.C.K.S.S.%22&t=brave&ia=web for a list of my past articles that mention the need for L.O.C.K.S.S. – “Lots of Copies Keeps Stuff Safe”.

Saturday, August 24, 2019

Google Photos just got an Awesome Feature...automatically convert printed words inside the picture into computer-readable text.

Google Photos just got an Awesome Feature that makes it a Must-Have for Android, iPhone, and iPad Devices

This article isn’t about genealogy but it is about a new software tool that will be valuable for genealogists and for millions of others.
From an article by Chris Smith in the BGR.com web site:
“Google Photos is easily one of the best apps you could have installed on your phone, especially if it’s an Android device, and especially a specific type of Android that comes with unlimited storage. Even if you prefer a different cloud or storage device for your photos, you should still consider getting the Google Photos app on your Android or iPhone right now, because the service is about to get a super convenient feature.
“That’s optical character recognition (OCR), a feature that allows Google to read the text in photos and turn it into text that you can search for, and even copy and paste into documents. That’s a handy feature to have on a phone, especially if you find yourself taking lots of photos of things that contain plenty of text that you’d want to be able to access later.”

Yes, take a picture of a sign or of a page in a book or of a document and Google Photos will automatically convert printed words inside the picture into computer-readable text.
Similar software that is to be installed in your computer has been available for years but at rather high prices. Now Google Photos will do the same thing for free and with no software installed in your computer. It works on Windows, Macintosh, Chromebook, Linux, Android, IPad, iPhone, and other operating systems because all the software runs in the cloud.
You can read the details in Chris Smith’s article at: https://tinyurl.com/eogn190823.

Wednesday, August 7, 2019

Millions of Books Are Secretly in the Public Domain

Millions of Books Are Secretly in the Public Domain

Genealogists are usually told that books published prior to 1924 are in the public domain and can be freely copied. Indeed, that is true. However, we also have been told to be cautious about copying large amounts of data published in books published in 1924 or later because those books might be under copyright. However, there are millions of exceptions.
Indeed, many books published between 1924 and 1964 MAY have fallen out of copyright. The problem is that determining the copyright status of a 1924 or later book has always been almost impossible. However, thanks to the New York Public Library, we can now determine copyright status easily.
According to an article by Matthew Gault in the Motherboard web site:

“Prior to 1964, books had a 28-year copyright term. Extending it required authors or publishers to send in a separate form, and lots of people didn’t end up doing that. Thanks to the efforts of the New York Public Library, many of those public domain books are now free online. Through the 1970s, the Library of Congress published the Catalog of Copyright Entries, all the registration and renewals of America’s books. The Internet Archive has digital copies of these, but computers couldn’t read all the information and figuring out which books were public domain, and thus could be uploaded legally, was tedious. The actual, extremely convoluted specifics of why these books are in the public domain are detailed in a post by the New York Public Library, which recently paid to parse the information in the Catalog of Copyright Entries.
“It amounts to an explosion of new books once lost to the mire of potential copyright claims. And they’re all free.”
The same article provides a lot of additional details, including where to download these free public domain eBooks. The list is expanding daily so if you don’t find what you want today, check back again later. You can read more at: https://tinyurl.com/eogn190806.

Monday, June 10, 2019

Follow-up: Ancestry.com is under Fire as new DNA Algorithm Drastically Changes the Ethnicity of Some Users

Follow-up: Ancestry.com is under Fire as new DNA Algorithm Drastically Changes the Ethnicity of Some Users

The following is a follow-up to my previous article at: http://bit.ly/2DN6o8y:
In the earlier article, I wrote:
“Ancestry.com is updating its databases and altering the results for some users. The new findings of ethnic origins has sent some users into a full-blown identity crisis. If you previously had your DNA tested by Ancestry and have already found your family’s ethnic origins, you might want to go back to the AncestryDNA web site and check again. The results may have changed.”
Some readers posted comments posted at the end of the article by newsletter readers questioned whether or not this was a new update to Ancestry.com’s DNA databases. However, that question seems to be cleared up by the following information written by the Ancestry Team and published in the Ancestry Blog at https://blogs.ancestry.com/ancestry/2019/05/02/understanding-your-new-ethnicity-estimate/ on May 2, 2019:

“Understanding Your New Ethnicity Estimate
“We’re always looking for new ways to help support our customers on their journeys of personal discovery. Often that means updating our products and services to take advantage of the most advanced science and technology.
“Last fall, we introduced the capability to provide more precise ethnicity estimates to our customers using an algorithm that analyzes longer segments of genetic information. For some of our existing customers, this has meant that previous ethnicity estimates have evolved as a result of this new technology.
“We recognize that an individual’s personal sense of identity is very important and that any journey of personal discovery may take turns that are surprising or unexpected. However, it is important to keep in mind that your DNA doesn’t change, but the science and technology behind understanding it constantly evolves and we endeavor to ensure that this cutting-edge science is reflected in our offerings.
“All AncestryDNA® customers who have not already transitioned to their new, more precise ethnicity estimate will be transitioned starting May 30, 2019. If you received your AncestryDNA® results prior to September 2018 and wish to keep a record of your prior results, you may download them by July 20, 2019.”

Monday, May 27, 2019

Struggling Care Worker Becomes Lord of $60 Million English Estate After DNA Test

Struggling Care Worker Becomes Lord of $60 Million English Estate After DNA Test Proves He’s an Heir

Did you ever wish to inherit a fortune from a rich uncle who had recently passed away? That happened to Jordan Adlard-Rogers. He received a roughly $60 million inheritance from an uncle that previously Adlard-Rogers was not certain was his relative.

Adlard-Rogers — who reportedly grew up in a council house and suffered long periods of financial hardship — has now quit his job and moved into the estate. The 1,536-acre Penrose Estate is said to be where King Arthur was mortally wounded and died.

You can read a lot more in an article by Phil Boucher in the People web site at: http://bit.ly/2JEZyq3.

Friday, May 24, 2019

23andMe is Updating Ancestry Results Without Telling Users

23andMe is Updating Ancestry Results Without Telling Users

An article by Dan Robitzski in the Futurism.com web site at https://futurism.com/23andme-updating-ancestry-results states:
“If you took a genetic ancestry test through a company like 23andMe, you may want to go back and give your results a second look.
“That’s because as the company gathers more data and learns more about genetic trends, it may update the results for your specific DNA and change around where it believes your family came from, according to STAT News. While it makes sense that these companies would eventually hone in on more accurate results, the shifting reports can be a rude shock to people who used the app to figure out their personal identity — only to find, like 23andMe user Leonard Kim, that the results later shift without warning.”
This shouldn’t be a surprise to anyone who reads this newsletter. I wrote an article a few weeks ago that describes the same thing with Ancestry.com’s test results: the company’s DNA ethnic origins reports changed as more and more information was added to the company’s findings of ethnic origins. You can find my earlier report at http://bit.ly/2DN6o8y and a follow-up article at http://bit.ly/2HxniKH.

I had a similar “change of ancestry” with the findings of another DNA test from still another testing company. It seems that such “changes” in your ancestry are not unusual.
In fact, I suspect that every DNA testing company will occasionally change their reports of customers’ ethnic origins as each company adds more and more information to their databases of historic DNA and various human migration patterns.
If you had your DNA tested by ANY company, I would suggest you go back to the testing company’s web site every few months to see if there are any updates to your earlier test results. If so, you might want to trade in your German lederhosen for a Scottish kilt.

Tuesday, May 21, 2019

GEDmatch Implements Required Opt-In for Law Enforcement Matching

GEDmatch Implements Required Opt-In for Law Enforcement Matching

GEDmatch is an open data personal genomics database and genealogy website founded in 2010 by Curtis Rogers and John Olson. Its main purpose is to help “amateur and professional researchers and genealogists,” including adoptees searching for birth parents. However, it recently has also become “the de facto DNA and genealogy database for all of law enforcement,” according to The Atlantic’s Sarah Zhang.
GEDmatch recently gained a lot of publicity after it was used by law enforcement officials to identify a suspect in the Golden State Killer case in California. Other law enforcement agencies started using GEDmatch for violent crimes, making it one of the most powerful tools available for identifying “cold case” criminals.
Sadly, the same site also has generated a lot of controversy involving the lack of privacy of personal DNA information, both for the people who uploaded their own DNA data and especially for the relatives of the uploaders whose DNA information also was included without their permission and usually without their knowledge. Such blatant disregard for personal privacy may be a violation of privacy laws in many countries.
The GEDmatch owners have now tightened the web site’s rules on privacy. The result is expected to make it much more difficult for law enforcement agencies to find suspects.

Judy Russell, often referred to as “The Legal Genealogist,” has written an explanation of the issues involved and the reasons for the decision by the GEDmatch owners. Judy wrote:
“The new system fully conforms to all legal definitions of informed consent — particularly in light of the candid admission in the terms that GEDmatch can’t promise there won’t be new non-genealogical uses of the site someone figures out in the future that nobody is even thinking of today — and to the provisions of the European Union’s General Data Protection Regulation (GDPR) as well.
“And it’s a good, right, ethical decision. Doing as much as any website can to protect the trust of genealogists that their DNA data will be used only for the purposes to which they personally consent leaves the entire field on firmer ethical ground.”
You can read a lot more in Judy Russell’s article at: https://www.legalgenealogist.com/2019/05/19/gedmatch-reverses-course/.

Monday, May 6, 2019

Ancestry.com is under Fire as new DNA Algorithm Drastically Changes the Ethnicity of Some Users

Follow-up: Ancestry.com is under Fire as new DNA Algorithm Drastically Changes the Ethnicity of Some Users

The following is a follow-up to my previous article at: http://bit.ly/2DN6o8y:
In the earlier article, I wrote:
“Ancestry.com is updating its databases and altering the results for some users. The new findings of ethnic origins has sent some users into a full-blown identity crisis. If you previously had your DNA tested by Ancestry and have already found your family’s ethnic origins, you might want to go back to the AncestryDNA web site and check again. The results may have changed.”
Some readers posted comments posted at the end of the article by newsletter readers questioned whether or not this was a new update to Ancestry.com’s DNA databases. However, that question seems to be cleared up by the following information written by the Ancestry Team and published in the Ancestry Blog at https://blogs.ancestry.com/ancestry/2019/05/02/understanding-your-new-ethnicity-estimate/ on May 2, 2019:


“Understanding Your New Ethnicity Estimate
“We’re always looking for new ways to help support our customers on their journeys of personal discovery. Often that means updating our products and services to take advantage of the most advanced science and technology.
“Last fall, we introduced the capability to provide more precise ethnicity estimates to our customers using an algorithm that analyzes longer segments of genetic information. For some of our existing customers, this has meant that previous ethnicity estimates have evolved as a result of this new technology.
“We recognize that an individual’s personal sense of identity is very important and that any journey of personal discovery may take turns that are surprising or unexpected. However, it is important to keep in mind that your DNA doesn’t change, but the science and technology behind understanding it constantly evolves and we endeavor to ensure that this cutting-edge science is reflected in our offerings.
“All AncestryDNA® customers who have not already transitioned to their new, more precise ethnicity estimate will be transitioned starting May 30, 2019. If you received your AncestryDNA® results prior to September 2018 and wish to keep a record of your prior results, you may download them by July 20, 2019.”

Sunday, April 28, 2019

DNA Spotlight: The Shared cM Project

DNA Spotlight: The Shared cM Project

When you get your DNA results, the DNA company tries to give you a sense of how you are connected to your matches. They will identify each relationship as parent, close family, sibling, second cousin, third cousin, fourth cousin, distant cousin, etc.
On MyHeritage it looks like this:
MyHeritage DNA Match

On Ancestry it looks like this:
Ancestry DNA Match
It's important to understand that the relationship provided is just an estimate. There are actually a number of possible ways you could be related to any given DNA match.
Now take a look at those same images and notice that next to or underneath the relationship you see a number and the initials cM. cM stands for centiMorgans which is the unit of measurement for DNA. The more cM you share with a DNA match the more closely related you are. The less cM you share, the more distant your relationship.
The Shared cM Project
In order to understand better all the possible relationships you have with a DNA match, genetic genealogist Blaine Bettinger came up with a data driven tool called the Shared cM Project. Blaine asked DNA test takers to provide the amount of cM they shared with known relationships. From this he was able to create charts that showed the various possible relationships through the range and averages of centiMorgans.
From the data, Blaine produced the Shared cM Project chart below. In each box the first line is the relationship, the second line is the average cM for that relationship and the third line is the range he has determined based on the data.
So if we take the example above - 2nd-3rd cousin, 276 cM - we would look for the box where the average is closest to 276 cM. You'll notice that there are three boxes that are pretty close: Half 1C1R (226 cM), 1C2R (229 cM) and 2C (233 cM). If you look beyond the averages to the ranges you'll notice that there are even more possibilities. This is just to show that your actual relationship to your DNA match could be any of a number of possibilities besides what the DNA company estimates for you. In this particular case, I know the cousin personally and I am accurately able to identify her as my second cousin and not a third cousin or any of the other choices.
Blaine Bettinger, The Shared cM Project, https://thegeneticgenealogist.com
Blaine Bettinger, The Shared cM Project, https://thegeneticgenealogist.com
(Click to enlarge), Creative Commons attribution
Interactive Shared cM Project on DNA Painter
Recently Jonny Perl, the creator of DNA Painter presented a webinar about DNA Painter on Legacy Family Tree Webinars (which is free to watch). Jonny has transformed Blaine's chart into an interactive tool on DNA Painter.
Let's see how it works with two new DNA matches I received just today.
From the main DNA Painter home page choose the Tools menu option.
CM-DNAPainter1
On the next page choose the Shared CM Tool option:
CM-DNAPainter2Next put the amount of cM your share with your DNA in the Filter box.
CM-DNAPainter3For this exercise I will use my two brand new dna matches.
CMMatchesforNewCousins

For the first new cousin I get this result:
CM-DNAPainter4You can see there are a lot of possibilities for this relationship! In fact, this cousin I know personally. She and I are Half first cousins once removed (Half 1C1R). That result was in the second tier of options. It's important not to make assumptions when working with unknown matches.
The second new match of the day was also described as a 3rd-4th cousin.
CM-DNAPainter5It's interesting to see how much the results change just by changing the cM a bit. The results are quite different even though they were both presented in the same 3rd-4th cousin range. This person is unknown to me. I will have to compare our shared matches and do some research to determine which of the above relationships is accurate. It's intriguing and I can't wait to uncover this new cousin.
Both the Shared cM Project chart and DNA Painter are free to use.  These tools will greatly help you in your genetic genealogy research. Give them a try.
You can learn more about understanding your DNA results from classes in the Legacy library. If you are just starting out with DNA take a look at Blaine Bettinger's Foundations of DNA series. If you're already pretty comfortable with DNA then choose from among the 74 DNA classes in the library.

Marian Pierre-Louis is the Online Education Producer for Legacy Family Tree Webinars. She hosts the monthly evening webinar on the second Tuesday of each month.  Her areas of expertise include house history research and southern New England research. Check out her webinars in the Legacy library.

Ancestry.com Sued for ‘Misleading’ Customers About DNA Data

Ancestry.com Sued for ‘Misleading’ Customers About DNA Data

Genealogy information provider Ancestry.com has a “longstanding practice” of failing to get sufficient informed consent agreements from customers who submit medical and DNA information, a new lawsuit alleges.
Lori Collett sued the Utah-based company’s subsidiaries—Ancestry.com DNA LLC and Ancestry.com Inc.—for allegedly “misleading and deceiving patients in California and across the country about what Ancestry was actually doing with their DNA.”
Bloomberg news has a brief radio report about the lawsuit at http://bit.ly/2VAn7Gt.