Tag Archives: Ashley Moye

A Stocking Full of Metric Goodies

tsll

It’s been a while since my last column, and my bag of ideas has found itself overflowing with useful links on a myriad of topics. Seeing as how it is the holiday season, and I couldn’t choose a single topic any more than I can choose a single dessert at the holiday table, I decided to celebrate the spirit of giving with a mash-up approach, a veritable stocking stuffed full of metric-centric resources and commentary.

A stocking usually has something eye-catching and especially relevant sticking out of the top. So, let’s get this party started with a goodie bag of altmetrics, an alternative approach to metrics that measure the impact of scholarly research outside the ever-so traditional confines of citation-based metrics. In today’s online world, measuring scholarly footprints is no longer as simple as tracking formal citations. Not only has social media and the increasingly pervasive information super-highway introduced new channels for broadcasting and sharing works, but it’s also ushered in the world of open access and an ability to immediately both access and share scholarly publications. So, for example, how do we accurately capture the impact and value of work that may not only be formally cited, but may also have been shared through social media channels at length? Enter altmetrics, the buzzword that, although making its rounds since 2010, recently skyrocketed in popularity. If you haven’t noticed, even familiar faces are starting to climb on the bandwagon, such as EBSCO, who recently partnered with Plum Analytics.

Katie Brown, our library director here at Charlotte Law, introduced me to the concept when she was first hired. She also presented at the annual meetings of both the Center for Computer-Assisted Legal Instruction (CALI) and American Association of Law Libraries (AALL) this year, demonstrating some of the new altmetrics tools for assessing and tracking scholarly impact. Even the latest issue of the AALL Spectrum featured an article on altmetrics, which did a stellar job of providing an accessible overview of the field, highlighting various tools you can use for measurements, and clearly explaining a variety of reasons to consider utilizing altmetrics in your own sphere. If your curiosity is piqued and you want to learn more, here are a few more resources I’ve found:

  • The Altmetric Bookmarklet can be installed on Chrome, Firefox or Safari, and allows you to find article-level metrics for any paper you’re reading on your computer.
  • Publish or Perish is a free software program that retrieves and analyzes academic citations and raw data from both Google Scholar and Microsoft Academic Search, providing metrics that allow you to present your research data in its best light.
  • Altmetrics for Librarians and Institutions: Parts 1, 2, & 3 give a comprehensive overview of altmetrics in plain language. Part 1 covers the basics; Part 2 is specifically geared towards librarians, focusing on ways altmetrics can assist with selection management and illustrate collection value, providing you with real-time stats and increasing the value of the guidance you give to your own research community; Part 3 focuses on using altmetrics in decision making within a greater academic context.
  • The April/May 2013 ASIS&T Bulletin features a special section on altmetrics with a variety of more in-depth and specialized papers that demonstrate the broadening scope of altmetrics scholarship.
  • Scholarship: Beyond the Paper by Jason Priem is a somewhat technical piece, written by the founding father of altmetrics, but is definitely an interesting take on the future of altmetrics and the possibility that the traditional peer-reviewed journal and article approach is transitioning into an all-new scholarly communication system.

So let’s dig a little deeper into our stocking now, shall we, and see what the smaller gifts underneath may be?

David Lee King, one of my all-time favorite librarian bloggers, recently did a whole series of posts on “Analytics for Social Media.” King discusses social media analytics that his library tracks, starting with activities analytics, then moving on to audience, engagement, and referral metrics, and finishing up with the grand master of social media analytics – return on investment (ROI). What I enjoy is that he not only explains what metrics he collects and exactly how he counts them, but he also succinctly explains WHY he counts them. As he keeps his posts tastefully brief, I’ll let his words speak for themselves.

Did you miss the webinar from the Philadelphia Chapter of the Special Libraries Association (SLA) on “Leveraging User Data for Strategic Decisions”?  Never fear – the recording is available online. This webinar provides great examples of how two libraries are gathering user data to help make business decisions and to improve learning environments for patrons.

This blast-from-the-past blog post is a great reminder that you shouldn’t just be counting – you should be COLLECTING. Mary Ellen Bates has three, and only three, great questions to ask patrons after every job:

  1. Did we meet your information need?
  2. Would you like us to do additional work on this or set up an alert?
  3. How was this information useful to you?

Bates suggests that while not all patrons will respond, the testimonial information you get from these questions is invaluable in telling the true story of your library and its net worth. Make reports to management including the best stories and link it to any new initiatives you’re exploring. Bates also suggests, if applicable, developing a multiplier to represent how much time your research saves other employees, so instead of reporting the number of research hours you’ve done, you can report the value of the time you’ve saved. Basic counts then become a clear measure of impact on the bottom line.

And last but not least, as Santa supposedly covers the globe in a single night, here’s a little international flair to bring us home again. Did you know that the International Federation of Library Associations and Institutions (IFLA) has a Statistics & Evaluation Section, and even an e-Metrics Special Interest Group? Did you know that this section created a Library Statistics Manifesto in August of 2008 to serve as a certified document about the importance of library statistics? And, more importantly, did you know that they keep an up-to-date bibliography on the “Impact and Outcome” of libraries, including resources on impacts on information literacy, academic success, society, electronic services and more? The IFLA Section even joined forces a few years ago with some other major players to develop and test a new set of statistics that could be used by libraries worldwide. Collecting these statistics regularly on a national basis could provide reliable and internationally comparable data of both library services and library use.

And that brings us to the end of our stocking. At least it wasn’t an orange stuffed in the toe, right? Happy holidays to you all, and as always, feel free to send any questions or topics you’d like for me to cover in the future to amoye@charlottelaw.edu. Nothing makes my day brighten quite like hearing from a reader.

~Ashley Moye~

 Technical Services Law Librarian (TSLL)  is an official publication of the Technical Services Special Interest Section and the Online Bibliographic Services Special Interest Section of the American Association of Law Libraries.  This article originally appeared in the December 2014 issue and is reprinted here with permission.

Leave a comment

Filed under CharlotteLaw Library Team Members, Technical Services

OMGMetrics

tsll

When I first proposed beginning a column on metrics, it seemed like a common sense notion. In fact, the proposal practically wrote itself. Library metrics are the hottest of topics, as we’re simultaneously a service industry and an industry whose value to patrons and communities is difficult to quantify. This results in our necks traditionally being one of the first on the chopping blocks during cuts, and our staff and supporters constantly fighting for more allocated resources. Qualitative anecdotes don’t defend our worth effectively in this business-savvy, metrics-driven world, nor do they assure that we’re maximizing value for our patrons in our expenditure choices.

As a true librarian at heart, once the column was approved, I started my research. Often when beginning research, you cast your first net with extreme caution, prepared to be buried under a towering mound of inaccurate or inapplicable results. Surprisingly, despite the importance and value of library metrics, I discovered they aren’t touched on with near the frequency you’d expect. Why this phenomenon? I have some ideas.

Let’s face it. Librarians are rarely math-centric. I learned this as a MLIS student with an undergraduate degree in actuarial science. While like majors could bond over their commonalities, I always felt a little lost – who needs a math librarian? Further in to my library school career, I was swept up into Technical Services librarianship when I came in for a part-time reference desk job interview at my legal resources professor’s workplace and the Technical Services Director saw math featured prominently on my resume. She immediately usurped my reference interview and stole me away to the land of backlogs of Westlaw and Lexis bills, much to my delight. In retrospect, I don’t even remember interviewing formally. You say, “statistics,” and librarians’ ears perk up. You say, “I like numbers,” and their eyes light up. Then, they hand you a stack of papers covered with numbers and run before you can hand it back.

Yes, people who have bad memories from their math classes growing up are often squeamish around things number-related. While I understand that fear completely, library metrics are completely different. Hence, one of my goals at the outset of this column is to help our amazing group of technical services law librarian readers realize that hearing the word “metrics” is not synonymous with “panic.”

To begin, let’s go over some basic concepts and vocabulary regarding metrics and their uses in libraries. First, all metrics aren’t created equal – for example, they: (1) use different collection and evaluation methods; (2) speak to different audiences; and (3) serve different purposes. Understanding the breadth of this topic is the first real step in creating and tracking functional metrics, which can then effectively communicate value and aid in decision-making. There are many things you can measure in the library falling into the general categories of inputs, processes, outputs, outcomes and impacts.

“Inputs” is a fancy name for resources used to produce or deliver a program or service, like staff, supplies, equipment, and money. Through processes, these inputs become outputs – resources and services that you produce, including your available materials and the programs you organize and host. Input and output tracking gives you those first glance statistics, easy to count, measure, and report, as these are tangible things. Outputs are usually what are reported to stakeholders or decision makers, e.g., we check out this many books, we have this many research guides, or these many people use the library. However, these metrics don’t accurately demonstrate the value of our services and our products.

And here’s where outcomes and impacts come in. I tend to agree with the school of thought that outcomes and impacts are the same thing, seen from different perspectives. Outcomes are changes from the perspective of our customers and impacts are the same change from the perspective of a stakeholder, usually more of a high level change, with long-term effects on the larger community. These metrics are known by quite a few names, including impact metrics, performance metrics, and outcome metrics, and are primarily intangible, making them much more difficult to measure. Naturally, they also communicate the most value and provide the most guidance and support.

Let’s be clear. Metrics are different from statistics, and for that matter, so is data. Just because you did poorly in your statistics class or didn’t score highly on the quantitative section of the GRE doesn’t mean that you should run from data or cringe when metrics is bandied about in a meeting with stakeholders or decision makers. Formally, data is qualitative or quantitative attributes of a variable or set of variables which typically arises as a result of measurements. Statistics don’t even come into play until you study the collection, organization, and interpretation of this data. Even better, in the library world, statistics don’t necessarily require the use of Greek letters or even convoluted equations. Most statistics, measures, and metrics can be organized into operating metrics, customer and user satisfaction metrics, and value and impact metrics.

Operating measures and operational statistics (such as how many people came to the library, how many check-outs took place on a certain day, and how many hits we had on a database) lend themselves well to understanding resource allocation, improving efficiencies, and making budget determinations. Customer and user satisfaction metrics, on the other hand, tell us how well the choices we made are doing based on operating measures and indicate what improvements may be required.  Value and impact measures are incredibly meaningful in their own right, as they often incorporate satisfaction and the importance of separate outcomes. These are the most elusive of all measurements; so naturally, they’re the most valuable.

Martha Kyrillidou, senior director of the Association of Research Libraries statistics and service quality programs, once said “what is easy to measure is not necessarily what is desirable to measure.” This is such a true observation regarding metric gathering in libraries – easy measurements rarely result in meaningful statistics, meaning one of your first challenges is figuring out how to make the things you choose to measure meaningful. Simply put, a meaningful measure shows you how much value you’re getting out of your investment. This could mean the investment in the library itself and the value that the stakeholders or decision makers are getting out of that investment, or it could mean what sort of value your customers are getting out of how the library chooses to invest their resources, both in terms of financial outlay and in terms of staff time. To determine meaningful measures, you need to understand your stakeholders or decision makers, and you need to understand your customers.

For instance, quantitative resource usage information doesn’t show how or why users are using materials, or even indicate how satisfied they are with the products. Relying solely on quantitative data, such as a basic measure of number of hits, isn’t necessarily enough to justify value to stakeholders and customers. Our most popular blog post at the law school, according to easily generated WordPress statistics, is one featuring a cartoon sun. Looking at the numbers and reports, you’d assume this was an incredibly popular post and maybe even assume it contributes a lot of value. However, this particular post features a metadata tag for “cartoon sun,” and one of the most searched keywords that leads people to our blog is – you guessed it – “cartoon sun.” Here, it’s obvious that a simple number doesn’t communicate actual value to our customer base or to our stakeholders and decision makers.

Similarly, one database may feature twice as many hits as another database when comparing generated usage reports, but that could be because it has a convoluted interface (possibly even for the sole purpose of generated inflated hits). Again, just because it’s an easy measure doesn’t mean it’s meaningful. Qualitative data, such as patron survey feedback and user experience testing, provides the context within which to view these numbers. This often means using a hybrid approach of both quantitative and qualitative data.

So there you have it. The metrics world is wide and wild, and this column will do its best to shine light on as many parts of it as possible. In addition to detailed discussions of the general metric concepts already mentioned, additional topics will include collection methods, statistical concepts in a nutshell, resource usage statistics, COUNTER and SUSHI, collection and transactional statistics, consortia challenges, web metrics, altmetrics, faculty support, law firm and public law library metrics, performance indicators and benchmarks, as well as discussion of tools for presentation and manipulation of data.

I’m still figuring out how best to approach the column to meet the needs of our audience, and since the next issue is devoted to American Association of Law Libraries (AALL) Annual Meeting program reports, this column won’t reappear until fall. I’d love to hear any suggestions on format and approach, any questions you’d like for me to attack, or any topics you’d like for me to cover. Shoot me an email at amoye@charlottelaw.edu, and let me know what you think!

~Ashley Moye~

 Technical Services Law Librarian (TSLL)  is an official publication of the Technical Services Special Interest Section and the Online Bibliographic Services Special Interest Section of the American Association of Law Libraries.  This article originally appeared in the June 2014 issue and is reprinted here with permission.

Leave a comment

Filed under CharlotteLaw Library Team Members, Technical Services

What’s in a Day as a Charlotte Law Librarian?

We are excited to announce that the Charlotte School of Law Library won First Place in the “Best Video” category of the 2014 American Association of Law Libraries 2014 Day in the Life contest!

librarians on patrol: no book left behind

In Spring of 2013, in preparation for our impending move to a high-rise in uptown Charlotte, we began a massive book giveaway initiative to rid the collection of redundant materials, free up space, and share these resources with our law students and local legal community. Through this project over thirteen thousand books found loving families, but in the midst of the madness, a few books ended up scampering away that needed to come back home. Enter the Librarians on Patrol – in October, six of our staff, both strong and brave, took a trip in a U-Haul across state lines to find our babies and bring them back so they could be stored, wrapped and transferred to our new library shelves come January 2014.

Featuring: Aaron Greene, Ashley Moye, Brian Trippodo, Cory Lenz, Kim Allman & Minerva Mims

Filmed October 11, 2013 in Charlotte, North Carolina and Rock Hill, South Carolina

“Addy Will Know” courtesy of SNMNMNM – snmnmnm.bandcamp.com/

~Ashley Moye~

Leave a comment

Filed under Careers, CharlotteLaw Library Team Members, Events, Hidden Treasures, Librarians Can Be Fun Too, Unique Libraries

The New OrgSync Interface

OrgSync is releasing a powerful new update to improve your user experience.  This redesign features better organization, simplified navigation and added functionality.

The redesign release is planned for July 22, 2014.  We will notify you if this date changes.

 

And check out the new OrgSync iPhone app, which makes it easy to access what you need, when you need it!

While OrgSync is already mobile-friendly and can be accessed through all mobile web browsers, the new iPhone app can assist iPhone users in the following tasks:

  • Find and join organizations
  • Read the latest campus news
  • Discover and RSVP to events
  • Access campus information, bookmarks and forms
  • Connect with peers and organizational leaders
  • Contribute to discussions

For more information, and to download the app, visit http://www.orgsync.com/mobile.

~Ashley Moye~

Leave a comment

Filed under Student Information

AALL Spectrum Feature — Moving on Up: To a Deluxe Library in the Sky

interior stairway

A view of the interior staircase from the IT help desk on the fourth floor

Charlotte School of Law Library opened its doors in 2006 to an inaugural class of 86 students. In the early days of building our library stacks, we absorbed a collection belonging to the Mecklenburg Law Library that was no longer maintained by the local public library system. Our first home for the collection was in a repurposed three-story law office, and, while the building itself was a beautiful Gregorian-style mansion situated in the upscale urban area of Dilworth, it soon was deemed too small to meet the physical collection needs of our exponentially growing incoming classes and subsequent staff additions.

West Side Story

In the summer of 2008, we simultaneously cataloged and processed an extensive collection purchased from the former National Judicial College and packed up house and home, destined for a new location. The space was part of new development meant to bring rejuvenation and urban redevelopment to an area of Charlotte that had been the victim of urban blight and serve as a flagship of renewal for the area.

Unfortunately, soon after our move, the recession hit and the development of the area stagnated. Our law library space on the second floor of this building was designed with little input from the library staff and leadership, and the owners of the building resisted creating an interior that was too specific in meeting our needs. As the years passed, our student body grew to more than 1,500, and staff and faculty grew as well. The demands placed upon the law library’s facilities and infrastructure by this influx of patrons, in addition to our attorney members and public patrons, meant that our space was ill-suited to accommodate such demands. 

Moving, Part Deux

In late 2012, we learned that Charlotte School of Law was destined for uptown Charlotte, taking over nine floors of a premier center city office complex, Charlotte Plaza. This time around, we were fortunate to participate in planning our new library, and many of our suggestions were incorporated into the final design. Our main objective in designing the library was to meet the needs of students and faculty alike. We analyzed how our space was currently being used and tailored our new space to increase access and use.

Study rooms in our old space were highly sought after, so in our new space we increased the number of study rooms from 21 to 39 and scattered a number of these study rooms outside the library on other floors at Charlotte Plaza. Many students also appreciated the quiet study space at our old location, so we designated our entire space on the fourth floor as a quiet area. Our reference librarians are highly engaged with our students, so we created a reference hallway dedicated to these librarians’ offices in short walking distance from the reference desk. To enhance collaborative study among students and between librarians and students, we added two distinct Research Zones in the reference area, equipped with computer hook-ups and large monitors.

In order to make all areas of the library easily accessible to students and faculty, we included an internal staircase to connect the fourth and fifth floors. The circulation desk, reference desk, and information technology help desk are all situated directly off the staircase. Focusing on accessibility, we transitioned all of our treatises, state materials, journals, and regional reporters from compact shelving to static shelving.

Free to a Good Home

Although doing away with compact shelving and opening up the library space for our patrons was a welcome change, it did leave us with a conundrum on our hands. Space constraints had been few and far between in our old building, resulting in a somewhat unwieldy collection that had no business moving to our new building en masse. Second copies and non-updated materials abounded, especially reporter volumes, ranging on and on ad infinitum. Once we moved to our uptown building, discard projects would take on a life of their own, requiring use of a freight elevator and possibly even professionals. So, despite the fact that it made our inner librarian bones cringe and twinge, a large number of books needed to be sent away to the “farm” to while away their days in the sunshine, or, more preferably, be rehomed.

Beginning in the 2013 spring semester, we began preparing for our move with a massive book giveaway initiative, reducing our collection as well as allowing us to serve our law student and local legal communities. Over the course of a semester, the library team came together to identify redundant materials, remove them from the collection, and find them good homes. An online database was created via Google, displaying cover art and details of each title. Books were offered in phases, first and foremost to students and alumni as both resource materials and window dressing, well-suited for new lawyer offices, and then to faculty, staff, other local libraries, and the community. Through this project, more than 13,777 books found loving families, with only a few minor hiccups, and we were left with only 2,000 books remaining for the “farm.”

I’ve Got 99 Problems, but My Team Ain’t One

After celebrating our successful discard project, we began planning the spacing and organization of our newly culled collection. We spent days poring over blueprints, wandering the stacks with measuring tapes, and crunching linear feet measurements into calculators. Similar to many other law libraries, our collection is organized primarily into categories, such as regional reporters, journals, federal materials, and treatises, and, within each of these sections, by Library of Congress classification numbers. We also have a dedicated reference section focusing specifically on North and South Carolina law. With two floors and a wide range of shelving in addition to these divisions, simple planning turned into a strange logic puzzle, attempting to preserve our categories and maintain a natural flow of the collection across the floors. Once the final calls were made, we congratulated ourselves and moved on with our regular day-to-day duties.

Our original plan to place our shorter book shelves on the fifth floor to provide a clear line of sight was short-lived. It became apparent that our architects weren’t necessarily familiar with the nuances of library design. The reinforced flooring necessary for taller stacks was only available on the fifth floor, due to the third floor being occupied by a different company, which made it impossible for engineers to reinforce the fourth floor as well. Suddenly our logic puzzle was back with a vengeance, requiring reallocation—meaning more hands on deck, more face palms, and more desperate cravings for margaritas at lunchtime.

The library was the last department scheduled to move on Friday, August 2. However, at this point, both the fourth and fifth floors in our new building were still under construction due to the reinforced flooring required and the labor-intensive installation of the floating stairwell between the two floors. As a result, the library would have to make do with a much smaller temporary space until our permanent location was complete. We rallied and proved our flexibility, rising to the challenge of separating our essential collection for the temporary space and leaving the nonessential materials on the shelves in our old building for the duration of the semester.

A Team in Transition Stays in Transition

August 2 came, and we packed our offices with much fanfare, planning to start work on our temporary floor the following Monday. However, on the way back from a staff lunch outing, management was informed that our temporary library floor was not ready and that our staff would be spread out into unused offices throughout the building for approximately one week. Thankfully, this “temporary-temporary” arrangement lasted only the one week.

In our temporary library space, we proved that we were a team time and time again. We were only in this location for one semester, so the school was reluctant to incur any expenses renovating the floor for such a short period of time. As a result, four members of the circulation staff shared a small work space, all of our technical services staff was confined to one room, and reference librarians were spread out two to an office. There weren’t enough shelves put up for the course reserve collection, one of the doors didn’t even have a door handle, and students were frequently locked out of study rooms due to the way the door locks had been constructed. The library staff had to adapt to tightly packed spaces that housed our work desks, book carts, and overflowing book collection. Students were less than impressed with the temporary library. Library staff frequently had to remind students and faculty that the space was not permanent.

At Long Last, Welcome Home

After the semester closed and the holidays arrived, we went to our homes happily while movers and builders feverishly worked on preparing our new floors, and we were able to welcome in the New Year in our permanent space. Our students, faculty, and staff have all been impressed with our new facilities, and we all believe that it was worth the wait. Finally, we’re here to stay!

This article was featured in the May 2014 issue of the AALL Spectrum, the official magazine of the American Association of Law Libraries.

~Ashley Moye, Brian Trippodo, Erica Tyler & Kim Allman~

Leave a comment

Filed under Building Updates