Procedure for ETD Transfer, Conversion, and Load into CONTENTdm

...

• Use Filezilla to FTP the new thesis and dissertations from Proquest. Open Filezilla. Enter the Proquest FTP IP, 130.85.192.107, into the host field. Enter the username, proquest, into the name field. Enter the password into the password field. Enter port 990 into the port field. Push Enter. The last line of the top box on the screen should say "Directory Listing Successful" and the lower left-hand portion of the screen should be populated with files on the Proquest server. The left side of the screen shows your computer--find the ETD folder on your hard drive. Use the date to identify the new files that we need to obtain. Highlight all of the files we need by holding down the shift key while clicking the first and last files you want highlighted. Drag them to your ETD folder. The progress of file transfer will show on the bottom of the screen. Wait while all files transfer (you can minimize and do something else).
• Verify that you have all of the files that have been sent by checking the number of files against the number of files the e-mail notices said were successfully downloaded. Add the number of successful downloads. Highlight all the ETD files, right click, and select properties. The number of files stated in the notices should match the total here.
• Use 7-Zip to extract the zip files. Open 7-Zip. The folder that your files are in should be selected in the bar across the top of the window. If not, use the drop-down arrow to find it. Once you are on the correct folder, all of your zip files should display in the window. Highlight all of the zip files by holding the the shift key by clicking the first and last files you want highlighted. Click extract. The destination for the extract opens to C:\ETD\ZIP*\. Delete the *\ so that the files all go into the ZIP folder. Click ok.
• Use Windows Explorer to sort the files by going to the "View" menu and selecting "arrange by file type.". Select all of the files of a given type, and move the to the appropriate sub-folder: Highlight all of the PDF files by holding down the shift key while clicking the first and last files you want highlighted. Drag them to the PDF subfolder and drop them there (or alternately, copy and paste them). Highlight all of the XML files by holding down the shift key while clicking the first and last files you want highlighted. Drag them to the XML subfolder and drop them there or alternately, copy and paste them).

Prepare the files:

• Check for anything unexpectedly left over. ETD's with extra files will unzip into folders or into additional zip files. These will require some initial manipulation to prepare them. Take a look at the extra files and handle each case as appropriate as follows:
  Approval sheets--These are forms that the adviser signs approving the thesis or dissertation. These are extraneous extra files that should simply be deleted. Move the pdf and xml files to your usual directories and process as usual.
  Other data that is usually included in the main file and pdf appendices--Combine the extra files with the main file using Adobe Acrobat. Click "Combine" then click Merge Files Into a Single PDF. Click "Add Files" and select the ones you want to combine. Put the files in the order they should be combined. Click "combine files" and overwrite the main PDF with the new one. Move the pdf and xml files to your usual directories and process as usual.
  Non-pdf appendices and other files not meeting above criteria--Word documents, Excel Worksheets, and MPEG  videos (convert other video formats using Avidimux) may be included. Each should contain a note stating what type(s) of non-pdf files are attached as follows:
  Word 97-2003 Document
  Excel 97-2003 Worksheet
  Quicktime .mov Video
  MPEG .mp4 Video
  The exact phrase will make the files locatable for forward versioning as necessary. Additional file types should only be added on consideration of whether this is the best file type for presentation and archiving of the material and a standard note should be added to the above list.
• Open each PDF. Print If the PDF has a publishing rights form for the rights file.  , extract it from the document (document menu, "Extract Pages", page number of publishing rights form, click delete pages, and click extract pages as a separate file and choose the ETDPermission folder on the shared drive. Change the file name to author last name, first name. Delete everything in front of the abstract using the Delete Pages command in the Document menu (Find the last page before the abstract and note the page number. "Click Document" then "Delete Page." Input the page range you need to delete then click "ok" and then "yes.") Save the edited file with the same filename over-writing the original file. Put documents which we have the right to publish an "Open" Put document which we don't have rights for in a "Closed" Directly. Sort the metadata to to match those groupings. Some files will have missing thesis or dissertation. Handle these as follows:
  Missing Documents There are two reasons a thesis or dissertation may be missing. The document may be embargoed, or the document may have not been FTP'ed because it's a large file that couldn't be sent via the Proquest administration page, so was sent to Proquest on disk. To determine which case this is, take a look at the metadata and the DISS_submission publishing_option tag. This is usually the first field in the metadata. In that tag, there is a an embargo code set with a numeric embargo code:
  "0" - No embargo
  "1" - 6 month embargo
  "2" - 1 year embargo
  "3" - 2 year embargo
  "4" - Until specified date
  If the code is 0, we should have the file, and can obtain it by downloading from the ContentDM Administrator Resources & Guidelines page at http://www.etdadmin.com/cgi-bin/main/resources?siteId=75. Click on Dissertations & Theses @ University of Maryland, Baltimore County and search for the missing document. When you find it, download it and process as usual.
  If the code is 1-4, the document is embargoed and we won't receive the document until the embargo period has passed.
  At the end of the metadata file there is a DISS_sales_restriction code," and the date in that tag indicates when the embargo will expire and when we should receive that file. Note the file name along with the date the embargo will expire in the embargo list at the end of this procedure so that we can ensure that we receive the file when the time comes. When you process the metadata for embargoed documents in Excel, insert a note into the metadata for the document stating: "At the author's request, this dissertation isn't being made available at this time." The metadata is then uploaded as usual along with the title page. The metadata will be revised to remove this note when we receive the full file.

For other problems with the files Proquest FTP's to us, ask Michelle to call Proquest technical support at 877-408-5027 or 800-889-3358 (or email at tsupport@proquest.com or
http://support.proquest.com/ ) to find a solution.

Do the Open and Closed Ones in Separate Batches

...

• Open Editix.
• Open the XSLT file ETDConversion.xslt (go to file, open, then change the file type to XSLT 2.0 document (*.xsl *.xslt)
• Go to XSLT/Xquery transform a document
• In XML source find your XML file.
• In result find the directory you want the new file to go in and type the name with the extension .xml
• Click ok.

...

• Open the Excel template version 5.1.
• Run the macro "Delete_Everything" by using CTRL-X. This will delete the content of sheet 1 and any existing XML map. If there is not an existing XML map, it will make an error which can be ignore.
• Delete  the 2^nd worksheet sheet2 that has old content in it. Create a new worksheet and rename it sheet2 if not named that already.
• Return to sheet1, cell 1A. Use developer import to import the file you created using Editix.
• Press ctr-r to run the reformatter macro.
• Go to the 2nd worksheetsheet2.
• Separate the keywords by semi-colons by changing commas in the keyword field to semicolons where appropriate.
  Save your Excel file and the 2^nd worksheet sheet2 (you must be on it) as your tab-delimited file.file (file, save as, then in file type select tab-delimited)
• Be sure to close Excel or the next steps won't work.

...

• When all files are done, go back to ContentDM and select all files. Then click upload for approval. This will take awhile.
• After files are uploaded for approval, go to contentDM administration at https://server16629.contentdm.oclc.org/. Login using your Worldcat Account (if you don't have one go here: https://www.worldcat.org/account/?page=register&ref=http%3A%2F%2Fwww.worldcat.org%2F).
• Click on items, then change the collection to UMBC Theses and Dissertations. Cllick on approve. A list of all the files ready for approval will appear.
• For closed access files, edit each one, by clicking on permission and entering the IP addresses
  

  129.2.19.84; 129.2.19.100; 130.85.0-56.*; 130.85.58-255.*  C
  in the permissions field.

• Clicking the box directly under the IP address to only limit the item but to allow the metadata to show on the web.

•  If everything is in order, select all and approve them. Next, click on index in the menu bar, then click on index now. This will take awhile.
• Put all of your files from the batch, as well as any that Michelle has handled, on to a flash drive, and take it Lindsey. She'll add the new materials to the ContentDM back-drive.

...