9 How Do I Know My OER Is Ready?

From Finished Draft to Ready-to-Use OER

Completing the instructional content is an important milestone, but it does not necessarily mean your OER is ready to publish.

Before sharing it, complete the front and back matter that helps readers understand and use the resource. Then review the OER as a whole and invite others to review it too. Colleagues, students, and other reviewers can help you identify gaps, questions, and opportunities for improvement that are difficult to see after working so closely with the resource yourself.

In This Chapter

You’ll learn how to:

  • complete and review your front and back matter;
  • review your OER as a complete learning resource;
  • verify alignment with your Course Outline of Record (COR);
  • review accuracy, currency, accessibility, licensing, and attribution;
  • invite colleagues, students, and others to review your work;
  • use different reviewers for different kinds of feedback;
  • decide what to do with reviewer feedback; and
  • complete a final pre-publication check.

Complete Your Front and Back Matter

Front and back matter provide important information about your OER that may not belong in the instructional chapters themselves. What you include will depend on the resource you created, but there are several elements you should consider before publication.

Complete Your Front Matter

Your front matter introduces the resource and provides information readers may need before they begin using it. Depending on your OER, consider including:

  • Title and author or contributor information so readers can clearly identify the resource and its creators;
  • Copyright and open license information explaining how others may use the resource;
  • Adaptation and attribution information when your OER builds upon one or more existing resources;
  • An accessibility statement describing the accessibility practices used in developing the resource and how readers can report accessibility barriers;
  • An AI use statement when generative AI played a meaningful role in developing the resource;
  • Acknowledgments recognizing collaborators, reviewers, contributors, funding, or other support;
  • A preface or introduction explaining the purpose, audience, organization, or intended use of the resource; and
  • A table of contents that accurately reflects the structure of the finished resource.

See It in This Guide

The front matter of this guide includes examples of licensing and attribution information, an accessibility statement, and a statement explaining how AI was used in its development.

You do not have to reproduce these statements exactly. Use them as examples of the kinds of information you might provide in your own OER and adapt the approach to reflect your resource and how it was developed.

Complete Your Back Matter

Back matter provides information or resources that support the book but do not need to appear within the instructional chapters. Depending on your OER, this might include:

  • references or a bibliography;
  • a glossary;
  • appendices;
  • supplemental resources;
  • information about authors or contributors; or
  • other supporting material appropriate to your resource.

Not every OER needs every type of front or back matter. Include what helps readers understand, use, evaluate, and appropriately reuse your resource.

Make Sure It Represents the Finished OER

If you adapted an existing OER, some front or back matter may have come with the original resource. Review all of it rather than assuming it still belongs.

Before moving into review, make sure:

  • the title and author or contributor information is accurate;
  • copyright and open license information reflects the finished resource;
  • adaptation information is included when appropriate;
  • your accessibility and AI use statements accurately describe your work;
  • acknowledgments reflect the people and organizations that contributed;
  • the preface or introduction accurately describes the finished resource;
  • references, glossaries, appendices, and other supporting material are complete; and
  • information inherited from a source OER has been removed or updated when it no longer applies.

Now Shift From Creator to Reviewer

Once the content and supporting matter are complete, stop asking, “What should I add next?”

Begin asking, “Does this work as a complete learning resource?”

Start With Your Own Review

Before asking someone else to review your OER, experience the complete resource yourself.

Try not to edit every sentence as you go. First, look at the resource as a whole and pay attention to how the pieces work together. Then conduct more focused reviews of alignment, accuracy, accessibility, licensing, and attribution.

Review the OER as a Complete Resource

Read through the resource with fresh eyes and ask:

  • Does the organization make sense from beginning to end?
  • Does each chapter have a clear purpose?
  • Are there gaps where students may need more explanation or support?
  • Is anything unnecessarily repeated?
  • Does terminology remain consistent throughout the resource?
  • Do examples and explanations make sense in the context of this course?
  • Do transitions between topics help students understand how ideas connect?
  • Are there remnants from an original OER or another institution that no longer belong?
  • Does the finished resource feel like one intentionally designed book rather than pieces assembled from different sources?

If you adapted or remixed multiple OER, this final question is especially important. Your students should experience one coherent learning resource, even if its content originated in many different places.

Compare the OER With Your COR and Course Plan

Early in this process, you began with your course rather than a textbook. Now return to that starting point.

Compare the finished OER with your Course Outline of Record (COR). If you created a course map, use it as an additional reference. Make sure the resource you created still supports what students actually need to learn and do.

The Course Still Comes First

The COR is still the course. The OER is a resource designed to support it.

As your OER developed, you may have discovered interesting resources, added new material, or changed the organization. This is the time to make sure those decisions still support the learning experience you set out to create.

Ask:

  • Does the OER address the content students need for the course?
  • Are important topics missing or underdeveloped?
  • Does the sequence support the way students will learn the material?
  • Is the depth appropriate for the course?
  • Does each major section serve a clear learning purpose?
  • Is there content that could be removed because students do not actually need it?

Check Accuracy and Currency

You are the disciplinary expert. Before publication, review the content with that responsibility in mind.

Pay particular attention to:

  • facts and explanations;
  • discipline-specific terminology;
  • data and statistics;
  • research and references;
  • examples and case studies;
  • laws, standards, policies, or practices that may change over time;
  • links to external resources; and
  • content that was substantially revised or newly created during the development process.

This review is especially important when you have combined content from several OER or used AI during drafting, editing, or production. AI can be helpful throughout the development process, but anything included in your OER remains your responsibility to review and verify.

Verify Licensing and Attribution

If you kept attribution information with your content as you developed the OER, this should be a verification step rather than a reconstruction project.

Before publication, check that:

  • adapted and remixed OER content has appropriate attribution;
  • you can still trace material back to its original source when needed;
  • licenses permit the ways you have used and adapted the content;
  • licenses are compatible when you have remixed openly licensed materials;
  • images, media, and other third-party materials have appropriate permissions and attribution; and
  • your attribution records are complete enough to maintain as the OER changes over time.

If you discover something you are unsure about, return to How Do I Know If I Can Use and Change an OER? before publishing.

Confirm Your Accessibility Review Is Complete

Accessibility should have been considered throughout development rather than saved for the end. At this stage, confirm that the accessibility review has been completed and that changes made during later development did not introduce new barriers.

Check that:

  • the accessibility practices described in your accessibility statement are reflected in the finished resource;
  • available accessibility checking tools have been used;
  • images, tables, links, headings, lists, and other content structures have been reviewed;
  • linked and embedded resources have been considered; and
  • the formats you plan to provide to students have been reviewed.

If you identify concerns that still need attention, return to How Do I Make My OER Accessible? or work with ATRC for accessibility support.

AI Assistant: Give My OER an Editorial Review

After working on a resource for a long time, AI can help you look for patterns and inconsistencies that may be difficult to notice yourself.

You might ask AI to identify:

  • inconsistent terminology;
  • repeated explanations;
  • abrupt transitions;
  • differences in chapter structure;
  • undefined terms;
  • references to missing chapters, activities, or resources;
  • places where explanations may assume knowledge students have not yet developed;
  • inconsistent formatting or organizational patterns; and
  • possible gaps when compared with your COR or course plan.

For example, you might ask:

Review this OER as an editor. Identify inconsistencies, repetition, unclear transitions, undefined terminology, references that may no longer make sense, and places where the organization may be difficult for a student to follow. Compare the resource with the course information I provided and flag possible gaps. Do not rewrite the content. Give me a list of issues to review and tell me where each occurs.

AI can help you find things to review. It should not be the person who decides that your disciplinary content is accurate.

You remain responsible for verifying the content and deciding what changes should be made.

Invite Others to Review Your OER

Your own review is essential, but it should not be the only perspective your OER receives before publication.

After spending so much time developing a resource, you know what you intended to communicate. That can make it difficult to recognize what another reader will actually experience. Other reviewers can identify things you may no longer notice and bring expertise and perspectives different from your own.

You do not need every reviewer to evaluate the entire book. Different people can review different aspects of the resource.

Ask a Discipline Colleague to Review the Content

A colleague who understands the discipline can provide an important second perspective on the academic content.

You might ask them to consider:

  • Is the content accurate and current?
  • Are important concepts missing?
  • Is the terminology appropriate and consistent?
  • Is the depth appropriate for the course?
  • Are explanations clear enough for someone learning the material for the first time?
  • Are the examples accurate, relevant, and useful?
  • Is anything included that seems unnecessary?

You might invite a Palomar colleague who teaches the same or a related course, a colleague in your discipline at another college, a faculty member who may eventually adopt the resource, or someone you have connected with through an OER community.

Ask Someone to Review the Learning Experience

A reviewer does not have to be a disciplinary expert to provide useful feedback. Someone with experience in teaching, course design, or instructional design can focus on how students are likely to experience the resource.

They might consider:

  • Does the organization support the learning sequence?
  • Are explanations and directions clear?
  • Are headings and other structural elements meaningful and consistent?
  • Is the amount of information manageable?
  • Are students given enough support for difficult concepts?
  • Does the resource connect clearly with what students are being asked to learn and do?

An Instructional Designer can help review alignment, organization, learning design, and the overall student experience.

Ask Students to Review the Resource

Students bring a perspective that faculty and other experts cannot fully reproduce. They are the people who will actually have to find information, follow explanations, interpret examples, and learn from the resource.

You do not need to ask students to formally review an entire textbook. Current or former students might review selected chapters or provide feedback on questions such as:

  • Where did you get confused?
  • What explanations or examples were particularly helpful?
  • Was there terminology you did not understand?
  • Was anything difficult to find?
  • Were there places you had to reread several times before they made sense?
  • Was there anything you expected to find but could not?
  • What would make this resource easier to use or learn from?

Student feedback does not replace disciplinary or accessibility review. It gives you something different: insight into how the resource works for the people it is intended to support.

Give Reviewers Something Specific to Look For

Instead of simply sending someone the book and asking, “What do you think?” tell them what kind of feedback would be most useful.

You might ask someone to review the entire resource, but you can also ask them to focus on a particular chapter, topic, feature, or concern. A focused request is often easier for the reviewer and more useful to you.

Build Your Own Publishing Team

Different reviewers can contribute different kinds of expertise:

  • You make the final decisions and remain responsible for the disciplinary content;
  • Discipline colleagues can review accuracy, currency, terminology, depth, and disciplinary relevance;
  • Students can identify areas of confusion, navigation challenges, unclear explanations, and other aspects of the actual learner experience;
  • Instructional Designers can help review alignment, organization, clarity, learning design, and the overall student experience;
  • ATRC can provide accessibility and Pressbooks expertise;
  • Potential adopters can help identify what another instructor would need in order to understand and use the resource;
  • OER colleagues and communities can bring experience adapting, using, and reviewing openly licensed resources; and
  • AI can assist with editorial review and consistency checks, while you evaluate anything it identifies.

You do not need every type of reviewer for every project. Build the review process that makes sense for the resource you created.

Decide What to Do With Reviewer Feedback

Reviewers will not always agree with one another, and you do not need to make every suggested change.

As you consider feedback, ask:

  • Does this identify an accuracy problem?
  • Would this make the content clearer for students?
  • Does this reveal a gap or unnecessary content?
  • Would this improve alignment with the course?
  • Does this identify an accessibility or usability concern?
  • Is the suggestion based primarily on a different teaching preference rather than a problem with the resource?
  • Would making the change improve the learning experience?

Also look for patterns. One comment may reflect an individual’s preference. If several reviewers independently identify the same issue, that is worth examining closely.

Feedback gives you another perspective. You decide what belongs in the final resource.

Complete Your Final Pre-Publication Review

After you have completed your own review, gathered feedback from others, and made the changes you believe are appropriate, complete one final check of the entire OER.

Final Pre-Publication Check

Book Completeness

  • front matter is complete and accurately represents the finished OER;
  • back matter is complete as appropriate;
  • title, author, and contributor information is accurate;
  • the preface or introduction accurately describes the finished resource; and
  • information inherited from source materials has been reviewed and updated.

Content and Course Alignment

  • the OER aligns with the COR;
  • if a course map was created, the OER still supports the learning experience represented in the map;
  • required content is present at an appropriate depth;
  • unnecessary content has been removed; and
  • the organization supports the intended learning sequence.

Accuracy and Currency

  • content has been reviewed for accuracy;
  • time-sensitive information is current;
  • terminology is accurate and consistent;
  • examples and references have been reviewed; and
  • external links work as intended.

Accessibility

  • the accessibility review has been completed;
  • available accessibility checking tools have been used;
  • linked and embedded materials have been considered;
  • the formats students will use have been reviewed; and
  • remaining accessibility questions have been addressed or reviewed with appropriate support.

Copyright, Licensing, and Attribution

  • copyright and open license information is included;
  • adapted and remixed content is appropriately attributed;
  • licenses permit the uses and adaptations you made;
  • licenses are compatible where resources were remixed;
  • images, media, and other third-party content have been reviewed; and
  • source and attribution records are complete.

Review by Others

  • appropriate discipline colleagues or other content reviewers have provided feedback;
  • the student perspective has been included when feasible;
  • other reviewers have been included based on the needs of the project; and
  • reviewer feedback has been considered and addressed as appropriate.

Final Student Experience

  • the organization and navigation are clear;
  • chapter and section titles are meaningful;
  • the resource feels coherent even when content came from multiple sources;
  • links, media, and other resources work as intended;
  • instructions are clear when students are asked to do something; and
  • the formats students will use have been previewed.

Ready Does Not Mean Finished Forever

Your OER does not need to be the final version it will ever become.

It needs to be accurate, aligned, accessible, appropriately attributed, reviewed, and ready for students.

Once it reaches that point, it is ready to move from development into publication and sharing. After students begin using it, you can continue learning from their experience and improving the resource over time.

Where Would You Like to Go Next?

Choose Your Next Step

My OER has completed its review and is ready to share.
Go to: How Do I Publish and Share My OER?

I discovered accessibility issues that still need attention.
Go to: How Do I Make My OER Accessible?

I discovered larger content or organizational changes that I need to make.
Go to: How Do I Develop My OER?

I would like help reviewing alignment, organization, or the student learning experience.
Work with an Instructional Designer.

I need help with accessibility or Pressbooks.
Contact ATRC for support.

License

Icon for the Creative Commons Attribution 4.0 International License

Palomar Guide to OER and Pressbooks Copyright © by Kelly Falcone is licensed under a Creative Commons Attribution 4.0 International License, except where otherwise noted.

Share This Book