Integrating ALN into an independent study distance education program: NVCC case studies

This paper describes eight ALN courses developed under various Sloan Foundation-funded degree program initiatives at Northern Virginia Community College (NVCC) Extended Learning Institute (ELI). These chemistry, engineering, mathematics, and information technology courses offer useful lessons about what makes ALN courses successful. The courses incorporated ALN into an independent study format to increase interaction among learning participants while maximizing learner convenience and flexibility; some courses also focused on both online and in-person collaboration. A wide variety of other course design and delivery strategies contributed to the courses' success. The results of this study indicate that ALN courses can be viable and successful for community college students and that ALN can succeed in a distance education program delivered in an independent study format to motivated learners. NVCC/ELI's experience also suggests that ALN works within a multiple media approach to course design and delivery; that faculty selection, support, and development are critical factors in assuring quality ALN courses; that a wide variety of best practices can result in successful ALN courses; and that the learning effectiveness of ALN courses will continue to improve as better tools, content, and support are developed.


A. General Background
This paper describes several ALN courses developed under various Sloan Foundation-funded degree program initiatives as described below.These particular courses were selected because each possesses unique or noteworthy characteristics (see Table 1) that offer useful lessons about what make ALN courses successful.One guiding assumption in selecting these courses was that, at least in our experience, when courses were less successful it was generally for prosaic and well-documented reasons, whereas courses which succeeded did so due to a variety of interesting and instructive factors.The following courses were selected as case studies:

Case Study #1: Chemistry
College Chemistry I & II (CHM 111/112) are four-credit courses designed primarily for science and engineering majors.These courses explore the fundamental laws, theories, and mathematical concepts of chemistry.CHM 111 is required for the Associate in Science (AS) Engineering degree.CHM 112 also was originally required for the AS Engineering degree program, but this requirement was dropped in 1996 when the degree program requirements were revised.
CHM 111 and 112 are of special interest because they attract a high percentage of students with prior degrees.Over 50% of the enrolled students have bachelor degrees and 12% have master's degrees and/or doctorates.Many of Introduction to Internet Services (IST 128) is a three-credit course that provides students with a working knowledge of Internet terminology and services including E-mail, WWW browsing, search engines, ftp, telnet, and other services, as well as introducing students to related software packages and web page construction.IST 128 is an elective course for the AAS IST degree.

B. The College
NVCC is one of the three largest multi-campus community colleges in the United States and is the largest educational institution in Virginia.Founded in 1964, NVCC has grown rapidly so that in 1998-99, it enrolled 60,714 students (unduplicated headcount; 21,888 annualized FTEs).The college is comprised of five campuses and the ELI.
The ELI was established in 1975 as the College's distance learning administrative unit.It now has more than 11,000 enrollments per year (7,020 unduplicated headcount or 11.6% of the College's total) and offers more than 140 college credit courses delivered by a mix of cable and broadcast television, video and audiotapes, telephone, voice mail, print, World Wide Web, CD-ROM, and computer conferencing.From the beginning, ELI supported continuous enrollment in credit courses whereby students could enroll in classes at any point in the semester.Continuous enrollment and asynchronous learning continue to be at the heart of the ELI program.
ELI is organized as a home-study distance education unit.Geographic distance is not the barrier so much as distance through isolation caused by the students' hectic lives and difficulties of traveling even short distances in congested urban traffic.ELI primarily serves students whose busy lives and inability to get to campus preclude their participation in college courses.
Since 1991, ELI has received grant funding for three major development projects.With the first, through support from Annenberg/CPB's New Pathways to a Degree project, ELI developed Associates of Science (AS) degrees in Business Administration and General Studies for delivery at a distance.The second project, with grants from the Alfred P. Sloan Foundation, developed an AS degree in Engineering available using ALN through home-study distance education.The third project, still in process, is incorporating ALNs into the mainstream at NVCC as described below.The Alfred P. Sloan Foundation sponsors this program.

D. Intended Audience
The intended audience for the ALN programs is community college students who are employed or have significant outside responsibilities and find that time and location are major obstacles to attaining degrees.The intended students are those requiring flexibility to complete a degree program.Compared to their colleagues in campus-based courses, these students tend to work more hours at outside employment, have more family responsibilities, and in general have less uninterrupted time, especially during regular business hours, to dedicate to their college studies.

A. Motivating Factors for Program Development
ELI and NVCC's engineering faculty initiated the engineering degree ALN program funded by the Sloan Foundation.The program addressed the problem facing potential engineers enrolled in transfer-oriented degree programs of how to complete a degree program when encumbered with many professional and family obligations.
The engineering degree program was also developed as a proof of concept project funded by Sloan to determine the feasibility of offering home-study, distance-education ALN courses in these subject areas.
The second ALN project supported by the Sloan Foundation was designed to bring ALNs into the mainstream at NVCC through a large-scale deployment of ALN courses and degree programs in key disciplines.The project is intended to address the need in Northern Virginia to have educational opportunities which are accessible anywhere, anytime for the growing new majority of students who face significant obstacles preventing them from attaining degrees via traditional on-campus classes.The project also addresses the critical shortage of information technology (IT) workers in Northern Virginia and the resulting high demand for IT courses at the College, as well as the need in Northern Virginia for education and training opportunities relevant to public sector employment.
The ELI was one of the few institutions using distance ALNs before the Sloan Foundation initiatives, so the ALN projects fit neatly into ELI's existing structure.In fall 1989, ELI introduced the use of computer conferencing on the mainframe computer for use in instruction.Voice-mail conferencing was introduced in 1993.With the Sloan grants, computer conferencing on personal computers using a bulletin board system began in 1995.The first courses delivered via the World Wide Web were offered in 1998.

B. Evaluation Methods
Originally, planned evaluation activities included formative and summative evaluations.Planned formative evaluation consisted of ■ Focus group meetings of students to get feedback on the effectiveness of pilot courses ■ Faculty and student surveys on the effectiveness of courses, technologies, and procedures ■ Grade distribution studies to determine rates of student success Planned summative evaluation consisted of ■ Faculty and student surveys on the effectiveness of courses, technologies, and procedures ■ Grade distribution studies to determine rates of student success ■ Telephone interviews with students to determine their satisfaction with the courses ■ Interviews with faculty, staff, and administrators on project outcomes ■ If possible, a tracking study to determine graduation and transfer rates for students who take a majority of the program by distance education The original evaluation plan was intentionally short on details so that suitable evaluation activities could be developed as the project progressed.Various evaluation methods were employed during the project periods; those related to learning effectiveness are described in the Results section below.

III. BACKGROUND INFORMATION FOR THE NVCC CASE STUDY COURSES
The students served in the engineering project are fairly similar to engineering students enrolled in on-campus courses.However, as in other distance programs, the students are slightly older and more often employed full-time than those in on-campus programs.Since its development, the ELI engineering degree has had over 1,300 total enrollments.Program enrollments declined slightly after peaking in fall 1997 and now number more than 300 per academic year.Comparative analyses show that students who start their courses have achieved success rates comparable to their on-campus counterparts.
The courses discussed in the case studies have been offered a varying number of times (see

A. Technology and Infrastructure
As described below, computer technology was used primarily to facilitate interaction among learning participants and only secondarily for content delivery in some courses.College Chemistry I and Introduction to Engineering were two of the first courses developed as part of Sloan's initial grant to NVCC/ELI.For the first iteration of these courses, Lotus Notes v4.13 was used as the course development and management system.This was before Lotus's development of Lotus LearningSpace.Although Lotus Notes was a powerful system with many useful features, Lotus Notes was replaced with FirstClass (with Internet access) in the spring 1996 semester as an alternative that would be easier to use and administer, less expensive for the institution and students, and equal to Notes for instructional purposes [1].FirstClass was subsequently used for the College Chemistry II, Vector Calculus, Differential Equations, and Introduction to Engineering courses.ELI managed technical infrastructure in-house.Consulting services were used in the initial installation and implementation of FirstClass, but operation and maintenance proved to be sufficiently simple that no additional consulting services were used even though funds were set aside for that purpose.As E-mail has become more widely available at the College and for its students, the advantages of using FirstClass have diminished.Accordingly, all case-study courses that are still using FirstClass are being migrated to a Web-based conferencing system (Allaire Forums) as of the fall 1999 semester.

B. Content Delivery
In the early and mid-1990s when most of these courses were developed, ELI utilized a multiple media approach to course development.The earlier courses were designed with a specific model in mind: video and print media for content delivery, computer conferencing and telephone for interaction facilitation.When computer conferencing was used for content delivery, it was only as a supplementary means, for example, homework help, questions and answers, or assignment transmission.By contrast, the courses developed in the past two years utilize the Web as the principal delivery medium along with selected course delivery management tools and other software as described below.In addition, the use of various methods and media evolved in different ways in different courses over time.Table 3 summarizes the use of media in the case-study courses by semester.
Most ELI courses feature self-paced, independent study as well as continuous enrollment, which allow students to register for most ELI courses on virtually any day of the year.However, for most of these courses, continuous enrollment was suspended to enable face-to-face activities and other forms of cohort formation to facilitate collaborative learning activities.For the mathematics courses, however, as it became apparent that learning participants were most comfortable with instructor-student interaction and cohort formation was unnecessary, continuous enrollment was re-instituted.
Several noteworthy content delivery strategies were employed in the case-study courses.For the chemistry courses, technological innovations were field-tested in the classroom before incorporating them into the ELI ALN courses.
For instance, the instructor field-tested the use of ChemSkillBuilder electronic homework exercises on campus in spring 1998, then incorporated them into the ELI ALN course in fall 1998.Similarly, the use of CD-ROM material bundled with a revised edition of the course textbook was piloted on-campus in spring 1999 and was incorporated into the ELI ALN course in the fall 1999 semester.

Syllabus
Course guide Textbook(s) Laboratory guide (HW Help/e-lectures) Homework assignments  In the spring 1999 semester, this content was customized by the IST 128 instructor to make the course more specific to its student population.
One noteworthy challenge related to content delivery involved how to facilitate affordable, two-way transmission of equations, formulas, and graphical content.Although software such as Mathematica and Maple V were available at the time, they were far too expensive to be considered for use by home-study, community college students.Instead, a solution was developed which used an equation typesetter product called Expressionist which, used with FirstClass, provided an affordable means (<$2/student) for students to compose and transmit documents with equations, formulas, etc.This solution proved to be serviceable in the mathematics courses for several semesters [2] until a better solution was identified, which was incorporated into the Mathematics for the Liberal Arts courses.These courses use Scientific Notebook as the means of mathematical communication with students.The instructor and students use the software to transmit quizzes, homework problems, and general questions and answers to each other.The instructor arranged for the textbook publisher to bundle Scientific Notebook with the course textbook at a greatly reduced rate ($29.95 vs. $75 retail).Besides its equation-editor capability, Scientific Notebook also contains the Maple symbolic engine for computational power; Scientific Notebook also has one of the easiest user interfaces of the available math software packages.The instructor currently uses MSWord with MathType, the full version of the Equation Editor that comes with Word to post Web pages with mathematical content [3].This procedure is much easier and quicker to download than the previous common practice of embedding mathematical expressions within graphics on Web pages.
Student performance was assessed in a variety of means (see Table 4).Tests and quizzes were conducted in the same manner as with all ELI courses; students were required to take exams at a testing lab at one of NVCC's five campuses.Students outside the NVCC service area could arrange for local exam proctoring as necessary in accordance with ELI's existing procedures.Of special interest is how quizzes were conducted in the mathematics courses.After studying the related material, students requested a quiz, which was sent to them via E-mail.The student used Scientific Notebook to complete the quiz and then returned it to the instructor.The quizzes were graded excellent, satisfactory, or unsatisfactory; however, the student received full credit for submitting the completed quiz, regardless of the grade.Since the ten required quizzes collectively comprised 25% of the course grades, students, in effect, were rewarded for effort rather than punished for practice, while the instructor received valuable feedback on student progress, which was used to monitor and improve student performance.

V. RESULTS
Overall, the case study courses have been successful both compared to other ELI courses and to their on-campus counterparts.Although comparisons have not been done for each individual case-study course, extensive evaluation activities performed on the Engineering degree program as a whole indicated that students who started Engineering degree program courses were roughly as successful as their on-campus counterparts [5].

A. Faculty Perceptions of Learning Effectiveness
As indicated in Tables 6 and 7 below, according to the case-study faculty this success is attributable to a variety of course design and student-related factors.The factors cited by faculty as necessary for student success (see Table 7) are not surprising, as they are in line with ELI's past experience with home-study, distance education learners.This is reflected for instance in ELI's "Is ELI for Me?" questionnaire, a ten-question, self-administered student survey designed to allow students to assess whether distance learning is suitable for them.The questionnaire contains similar questions about personal preferences for interaction, need for course, reading ability, etc.This questionnaire has been widely adopted and distributed in various forms throughout higher educational institutions in the U.S.

Mathematics (MTH 277/291)
As described previously, the use of quizzes to enable students to practice performance without punishment has proved to be an effective means for the instructor to provide feedback and monitor progress more frequently.Improvements in the enabling technologies have increased the ease and convenience of this interaction.The instructor noted that the initial enabling technology used (Expressionist + FirstClass) was a definite improvement over paper and pencil.However, Scientific Notebook also represented a definite improvement over Expressionist + FirstClass because it is a more convenient equation editor and a more powerful math tool which enables students to focus on the problem-solving process.Scientific Notebook can also be used for many math courses.Similarly, the instructor has found the Web to be better than the FirstClass client environment because it has more flexible space, fewer constraints, and is more accessible since it is easier to install and use.The instructor also noted that all of math content in his calculus and liberal arts math courses is suitable for delivery via the Web, although he speculated that dealing with discrete math proofs could be a problem.

Introduction to Internet Services (IST 128)
The instructor noted several minor technological and pedagogical aspects that impeded learning effectiveness.There was too much written text on the screen; the course materials were so densely hyper-linked that it was virtually impossible for students to print it out; some of the category labels within Serf were non-intuitive and difficult for students to figure out; and access to the Serf Website was often slow and occasionally unavailable.However, the instructor also felt that the advantages of using Serf and the on-line Internet Literacy course outweighed the disadvantages.Having pre-organized publisher resources was much more efficient and timesaving for both students and instructor.Using customizable pre-packaged course material allowed the instructor to adapt the existing course material to students' needs.Another development noted by the instructor was a tendency toward supporting a more mastery learning-oriented approach to assessment by allowing students to resubmit substandard assignments (not including exams).The instructor's experience was that, by having a well-organized structure and supporting rapid feedback, the technology made this much easier to do, unlike on-campus courses where such an approach was impractical.
These features not only facilitated learning effectiveness but also increased the instructor's capacity to teach larger numbers of students effectively.They also encouraged a much greater volume of student/instructor interaction.Although exact figures were not available, the instructor estimated that she had at least ten times as many one-onone interactions with students in her ELI ALN course than with students in her on-campus courses.Another subjective but perhaps telling indicator of the success of one-on-one interaction is that several students who had never met the instructor face-to-face while taking the course came to visit the instructor at ELI's semester orientationafter they had already completed the course.
Several common themes emerged from the case-study courses.One of them was that ELI students often seemed to learn more in-depth than students in on-campus courses.In the chemistry courses, this was attributed in part to the ELI classes having a much higher percentage of excellent students, at times "just extraordinary".The IST 128 instructor felt that students learned more and received better grades because she was able to "hold [her students'] feet to the fire more" than was possible in an on-campus class.Another possible explanation is the fact that homestudy courses such as ELI's do not allow instructors to skimp on content covered in the latter stages of a course due to time constraints.
Another commonly mentioned factor to consider was the variation in course performance from semester to semester within the same course.Just as with on-campus courses, this is probably more a function of the particular collection of students enrolled in a course in a given semester than a function of the courses themselves.This is a factor worth considering when assessing learning effectiveness in ALN courses, especially in comparison to on-campus courses.

B. Student Perceptions of Learning Effectiveness
A series of student-focus groups was conducted over several semesters for the engineering degree courses, including the chemistry, calculus, and engineering case-study courses.Both the overall responses (n=51) and the responses in case-study courses (n=13) reflect a generally favorable student perception of learning effectiveness.A large majority (84%) of students overall felt that they had equal (74%) or greater (10%) access to learning resources in ELI ALN courses than in on-campus classes.An even greater majority (92%) was satisfied with their level of access to learning resources in ELI ALN courses.Two-thirds (over 70% in the case study courses) felt that ELI ALN courses were an equally or more effective way to learn than on-campus classes.Over 90% of student respondents said that they would take another ELI course based on their experience in the Engineering degree courses, thus indicating high overall student satisfaction.

C. Course Grades
As Tables 8 and 9 indicate, the case-study courses, as is generally the case with distance-learning courses everywhere, have a higher student withdrawal rate than on-campus courses; however, students who started casestudy courses have success rates comparable to their on-campus counterparts [5].Although the grade results for the non-engineering degree courses are incomplete, results thus far indicate that these courses will have similar success rates.Course grades also reflect the typical ELI pattern (for both ALN and non-ALN courses) of polar success/failure, i.e., lots of As and Fs, some Bs, and very few Cs and Ds.Table 9 also indicates comparative results for the same instructor when that same instructor taught the same course both on-campus and at ELI in the same semester.Comparison data by instructor is limited, partly because most instructors opted to drop their on-campus sections of the same course after beginning to teach or while teaching the ELI ALN versions.However, within the limited data (in the chemistry courses), it is striking how similar the results are between the ELI ALN and on-campus courses.While course performance has varied by semester, this is probably a function of the particular collection of students enrolled in a course for a given semester rather than a reflection of the courses themselves.Other data indicate that performance varies at least as greatly from semester to semester within on-campus courses as it does between oncampus and ALN ELI courses.

VI. CONCLUSIONS
NVCC case study courses indicate that ALN courses, even those in their pioneering or early stages, can be a viable and successful way for community college students to learn.NVCC's experience with its case study and other ALN courses also support several other conclusions: ■ ALN can succeed in a distance education program delivered in an independent study format and designed to provide maximum flexibility and convenience to motivated learners.
■ ALN works within a multiple media approach to course and delivery; i.e., ALN courses do not have to be on-line cybercourses, but rather ALN courses that integrate various media can be delivered effectively.They present the comparison of the outcomes as well as some unique characteristics that each of the courses presents for effectiveness.They further explore NVCC's case studies with regard to how an institution conceptualizes a course for ALN delivery through implementation and how the institution supports its student from the very onset of interest in a course to completion of a course.This paper from NVCC will clearly point out that when a thoughtful approach to student outcome is the undergirding guide in ALN delivery, students can achieve a high level of success.
The learners that NVCC's Extended Learning Institute (ELI) identified as its primary market are students who are usually employed or have outside responsibilities that create a barrier to coming on campus for coursework.These individuals are non-traditional students in that the general age group is higher and they come to ELI with a skill set from their work experience.This group will have less uninterrupted time.Therefore, it is assumed they will approach their learning in unique ways.These types of learners constitute about one-half of ELI learners.The other group are onsite learners who have a variety of constraints and find the ALN approach to learning satisfying.
As a well-known fact, society is changing.The demographics of the United States are changing.Sixty-five percent of the population is over the age of 40.The economic climate is changing as it moves into the information age.Business is becoming more global and utilizing technology, thus, the need for education becomes imperative.Sectors of the population are seeking alternatives to traditional classroom instruction due to constraints on their lives and pressures from the changing economic climate.
Education has also been experiencing a shift in how to provide education due to the new demands of the economic environment.In ALN delivery, Northwest Technical College has found in ALN courses that the average student age is higher and the percentage of our non-traditional student (those taking ALN courses only) continues to increase.Most students come with a wealth of experience that creates a more diverse learning environment.Instructor's roles are changing to facilitate and direct learning versus traditional lecture modules.Dramatic changes such as these come infrequently in history.ALN is becoming a unique alternative to a unique set of societal problems.
As NVCC is a community college, the issue of serving entry-level students does arise.There are many learners who come to ELI who hold a higher educational degree and are experienced learners.Equally, there are also entry-level students who come to ELI who are not experienced learners and have a special set of issues regarding how to become a successful distance student.Entry-level students experience issues such as anxiety over successful outcomes and if they can accomplish outcomes successfully.ELI addresses this situation quite appropriately.
Before a student registers for an ELI class he or she is encouraged to take the pre-assessment evaluation that is posted on the Web site.Once students have answered the brief, but pointed questions on the assessment, they compare their answers to an answer sheet that will help them understand if they can be a successful distance student.If there are reasons why the student may not be successful according to the answers given, there are helpful tips for potential students to see why this may not be the right delivery method for them.

REVIEW
Once students have overcome their initial anxiety of entering an ALN course, they find if the course is well designed and well taught it is an exciting experience.The components that lead to this outcome are appropriate pedagogy and appropriate use of technology whereby the educational experience desired drives the choice of technology used to benefit and support the student in the best way possible.When these expectations are met, students can thrive in this learning environment and enjoy taking charge of their learning.
Many students approach ALN courses with some unique expectations.Students desire courses that are current and authoritative, flexible and accommodate a variety of learning styles, guidance on how and what to study, opportunities to do something with the knowledge they are obtaining, feedback on their work and their progress, and help working through administrative or personal issues related to the course (Moore and Kearsley, 1996).
History has shown us that many distance education courses have been developed and delivered in an unplanned fashion.This, of course, makes educators and students skeptical as they enter the distance arena.When distance courses are developed through a systems approach, then there are control mechanisms in place that lead to successful development and successful outcomes.By utilizing the expertise of a variety of individuals instead of depending on past practices of asking faculty to develop everything themselves, a richer, more comprehensive learning environment where students thrive occurs (Moore and Kearsley, 1996).ELI has taken this unique systems approach with good outcomes.
Computer technology is the method used to keep learners and instructors interacting.ELI has evolved the content delivery method from print to Web delivery in the past two years with course delivery management tools and various types of software.Different courses, however, used different media and it has evolved over time to address a variety of needs.Strategies for implementing computing technology were first field tested in the on-site classroom.
When they met with success, they were folded into the ALN as part of the delivery package.
ELI uses the expertise of faculty and instructional technologist to approach development of their courses and use formative and summative evaluation to ensure quality.These types of evaluations are helpful in ensuring student success.Within the formative evaluation, the instructor can tell right away if students are able to meet the learning outcomes.If they are not meeting course outcomes, then there is time to make some changes within the course to ensure that outcomes are attained.The summative evaluation is very helpful in the course as a whole and evaluating the systems that make the course successful.
In the courses of the four subject areas that are involved in this case study from ELI, the special requirements are as diverse as the courses are themselves.For example, in the Chemistry classes one needs to write an introductory letter and a plan for completion of the course whereby in the Math courses one would need to complete assignments and quizzes and credit is given in a unique way to encourage students taking charge of their learning.Outcomes are thought through carefully in these subject areas so that when a student has completed the course successfully, the skills they learned can be used immediately in a meaningful way.
It is this mindset that makes these courses excellent cases studies for NVCC and ELI.It is within the new paradigm that ALN delivery must address outcomes in the way that adult learners can learn.Thereby, they take into account adult learners limited chunks of time to work on courses plus the experience they have gained through their own lives.
The overall results for student success through these courses, based on grades, have been comparable to NVCC's on-campus courses.It was also noted that ELI courses have a higher withdrawal rate which is standard for ALN courses for a wide variety of reasons.Students who have started their ELI courses did complete with scores comparable to NVCC's on-campus scores.
ELI student focus groups were established over several semesters to determine student perceptions in learning effectiveness.Many students felt that they had equal or greater access to learning resources than in a traditional oncampus course.Seventy percent of students felt that ELI ALN courses were equal to or more effective than oncampus courses; 90% would take an ALN course again based upon experience in the Engineering courses.
The faculty for the case study courses attributed successes to a variety of course design and student-related factors.They determined that pedagogy and technology factors were critical for successful learner outcomes.The pedagogy and the technology factors that led to student success in each of the disciplines are different for a variety of reasons as stated above.Overall, faculty were satisfied with outcomes based upon student successes but noted that the mix of students one gets in a class also can be a defining point that leads to success or failure.

■■ 128 ■■
Focus on collaboration, particularly face-to-face in lab settings ■ Frequent/continuous improvement of course, including field-testing of technological innovations in on-campus classes before incorporating them into ELI ALN courses ■ Highly educated student population (~60% with prior degrees) EGR 120 ■ Combined on-line, face-to-face collaboration in simulation assignment MTH 277/291 Innovative use of methods for two-way transmission of equations and graphical content Innovative grading structure which rewards practice ■ Continuous course improvement IST Use of pre-packaged customizable course material within a Web course delivery program (Serf) High volume of student/instructor interaction ■ Large enrollments

Face
-to-face meetings were required for the Introduction to Engineering (EGR 120) and chemistry courses.The EGR 120 course required one face-to-face meeting designed as a culminating activity for an on-line collaborative learning assignment.The assignment required students to conduct a mock technical meeting of a fictitious engineering company dealing with an engineering-related manufacturing problem.The chemistry courses required two-to-five, face-to-face meetings to conduct laboratory experiments.The laboratories were self-contained activities in the College Chemistry II course; however, in the College Chemistry I course, students were required to work collaboratively to prepare pre-and post-lab reports.Wide Web LN = Lotus Notes (includes use of E-mail) FC = FirstClass AF = Allaire Forums S = Serf e-m: E-mail only • Indicated media was used during marked semester

W
= students who withdrew from the course NS = Non-Starters = students who withdrew before submitting any assignments I = Incompletes = students who have not yet finished their course R = Refunds = students who withdrew with refund before starting their course X = Audited course.

Table 2 )
. CHM 111 and EGR 120 were first offered in spring 1995 and have been taught most semesters since then.MTH 152 is the most recently developed of the case study courses and was taught for the first time in summer 1999.

Table 3 . ALN Activities, Resources and Media in NVCC Case Study Courses by Semester The
more recently developed courses use the World Wide Web in different ways to deliver content.The Mathematics for the Liberal Arts I and II courses (MTH 151/152) use instructor-developed pages rather than a commercial course management system.The Introduction to Internet Services course (IST 128) uses a pre-packaged course, Internet Literacy, which operates within a Web course delivery program (Serf), both of which were developed at the University of Delaware and licensed through the Public Broadcasting Service (PBS).

Table 4 . Student Performance Assessment in NVCC Case Study Courses C. Organization and Evolution 1. Course Development ELI
[4]s a faculty-centered course development model in which faculty members and instructional technologists collaborate to develop course materials for delivery.Faculty serve as content experts and are highly involved in developing and teaching their own courses.Instructional technologists provide instructional design expertise.The engineering degree courses were developed by teams, each composed of a faculty member, instructional technologist, a video producer (when applicable), and clerical support staff[4].Other staff instructional technologists were employed as consultants on an as-needed basis.The pioneering nature of the engineering degree program Although costs per course are difficult to quantify with precision since some costs (e.g., software) are not allocated per course, the figures in Table5represent reasonable estimates.Note that the figures in Table5do not include recurring course delivery costs.Although in most cases these costs are low, the IST 128 course incurs about $2-4,000/year in costs due to licensing and student fees.
2. Technical SupportELI staff instructional technologists provide technical support for course development and delivery.Instructional technologists train faculty in the instructional use of technology and provide technical support during the course development process.ELI instructional technologists also provide course delivery technical support, including trouble shooting for students and faculty and server administration.Front-line clerical staff answer basic technical questions from students and refer other questions to ELI instructional technologists.3.Course Development BudgetCourse development funds were provided by grants from the Sloan Foundation.The course development costs for the engineering degree courses and the more recently developed courses differ markedly.This differential is due to several factors:■Large decreases in software costs during the project development period ■ Pre-existing software infrastructure for more recently developed courses ■ Video production expenses for the engineering degree courses (except MTH 291) ■ *Includes video production and videotape distribution costs

Table 9 . Course-by-Course ELI vs. On-Campus Starter Success Rates, Cumulative
Faculty selection, support, and development are critical factors in assuring quality ALN courses, in particular because faculty are a key resource in generating best practices in course design and delivery.■ A wide variety of best practices can result in successful ALN courses, and we are just beginning to learn about what these best practices are.■ The learning effectiveness of ALN courses will continue to improve as better tools, content, and support are developed.Integrating ALN into a Home Study Distance Education Program" authored by John Sener and Merrily Stover from Northern Virginia Community College (NVCC) is a compelling report of how a college can respond to market need with above average outcomes.NVCC is dedicated to addressing the need of adult learners in their geographic area in many ways.For this case study, the focus is on NVCC's Extended Learning Institute (ELI) Chemistry, Engineering, Mathematics and Information Systems Technology courses. " Linda Thompson is the Director of Distance Education for Northwest Technical College, a multi-campus entity located in Northwest Minnesota.She has assisted the five campus of Northwest Technical College in the development and delivery of Distance Education via the web and through correspondence for the past three years.Linda brings to this arena 13 years of experience as an educator and her academic area is in the studies of technology, management and distance education administration.Contact: Northwest Technical College, Post Office Box 309, Perham, Minnesota 56573;Telephone: 701-795-8886, 218-347-6216; Fax: 218-347-6210; E-mail: linda.thompson@mail.ntc.mnscu.edu.