630.7 I£6b no. 762 cop. 8 The person charging this material is re- sponsible for its return to the library from which it was withdrawn on or before the Latest Date stamped below. Theft, mutilation, and underlining of books ore reasons for disciplinary action and may result In dismissal from the University. To renew call Telephone Center, 333-840O UNIVERSITY OF ILLINOIS LIBRARY AT URBANA-CHAMPAIGN •••'/*••-. - v "•tyro or ronew ;. ;/3 Fes for each Lc is S50.00 L161— O-1096 WHVIOTY J;: A.;:;iSULTUu£ LI^RY Research Productivity of the State Agricultural Experiment Station System: Measured by Scientific Publication Output G.W. Salisbury CIRCULAn. jj_COPY_ AGRICULTURE LI3RARY Bulletin 762 Agricultural Experiment Station College of Agriculture University of Illinois at Urbana- Champaign ACKNOWLEDGMENTS The investigations reported here on the scientific publication output of agricultural experiment stations in the United States were initiated as early as 1948 when the author as head of the Department of Dairy Science began keeping score on the progress of that one department. The effort was expanded to include the research productivity of all the domestic animal sciences in academe when the author was a member of the Agricultural Panel of President J. F. Kennedy's Science Advisory Committee, 1961-1963. It was expanded further to include all major subjects of agricultural research under Hatch Project 1-320, Research Productivity — A Study in Research Management, 1971-1977, when the author served as director of the Illinois Agricultural Experiment Sta- tion, 1969-1978. The detailed analysis of the Illinois Agricultural Experi- ment Station records was completed after retirement. Many people aided the author in the course of the acquisition of these data and their statistical analyses. It is believed that in most instances appreciation for that aid was expressed at the time it was provided. Those deserving special mention include R. J. Miller, director of the Idaho Agricultural Experiment Station who as associate director of the Illinois Agricultural Experiment Station helped extend the study beyond the limits of animal agriculture; F. M. Wilkens, who organized the details of recording the page-by-page analysis of the 31,911 papers constituting the major original contribution of this report; C. R. Ander- son and S. L. Warren, who supervised the statistical analysis of the data, the first as the explorer of its parameters and the second who placed the capstone; and J. H. Olson, who in 1977-78 made the first attempt to gather the findings of the several studies together as a coor- dinated whole. G. W. Salisbury no. Cop. ABSTRACT Three studies are reported of the scientific publication output of U.S. agricultural experiment station scientists for the period 1945 through 1978. The first study dealt with the 1945-1975 fiscal-year sequence of reports by the stations to the U.S. Department of Agriculture of their annual publication of technical journal articles. The second analysis was of three different three-year series of pub- lications by agricultural scientists in selected peer-edited agricultural science journals. The first subset for the calendar years 1958-1960 dealt solely with the number of publications in the subject matter of domestic animal research. The second for calendar years 1965-1967 dealt with the number of domestic animal research publications and also included a survey of the opinions of 85 scientists in the field of the relative rank- ing of the stations of the 50 states. The agreement between the station rank order by actual count of publications and the collective opinions of scientists of the relative rank of the stations was high. The third subset in this study was of full-length scientific papers appearing in 66 selected peer-edited scientific journals published during the calendar years 1967-1969 for ten different agricultural subject matters. The third study dealt in detail with the 30-year publication record (1948-1978) of the Illinois Agricultural Experiment Station by depart- ments and research units. Throughout all of these investigations some corollary evidence on total research funding and staff size of the de- partments, research units, or stations was available for study in relation to publication output. Statistical studies indicated that there exist real differences in the publication output among the states, with relative funding and staff size the important covariables. The rank order of the top ten stations changed when staff size and dollar funding were held statistically con- stant. The Illinois station ranked at about the center within the first ten state stations however the calculations were made. Within the Illinois station, the differences in publication output for the several units were largely determined by the input of constant-value dollars and the num- ber of scientists. The publication tradition and behavioral patterns of the several Illi- nois subject matter fields differed. The proportion of their total publica- tions published in peer-edited journals varied widely among units but changed little with time, and the Illinois behavior seemed not to differ from that of counterparts elsewhere. The rank order of the Illinois units in publication output varied with the measure of output used, total station-reported publications or peer- edited ones, but the magnitudes of the inputs into the units, numbers of senior scientists and number of dollars (actual or of calculated con- stant value) invested, were greater influences on the numbers of publi- cations resulting and the rank order. The Illinois station has performed its research function as measured by the standards of this research well above the mean of its U.S. coun- terparts. The question occurs as to why this should be the case. Aside from the observation that the senior staff is of more than average com- petence and, as individuals, are loyal and like what they do, there are no data to test the point. There is evidence that their peak efficiency has been reached and that the reduced public investment in constant- value dollars apparent in the past few bienniums has already resulted in a decrease in the output of the products of research the Illinois Agricultural Experiment Station was created to provide. CONTENTS The Agricultural Research System in the United States 8 Organization of Research at the Illinois Station 11 Scientific Publications as a Measure of Research Productivity 13 Source of National Data on Publications Output 14 Study I: A Review of Station Publication Numbers Reported by OES and CSRS 14 Study II: Peer-Edited Journal Articles 19 Study Ha: Journal Articles — Animal Agriculture, 1958-1960 ... .20 Study lib: Journal Articles and Opinion Survey — Animal Agriculture, 1965-1967 20 Study Ik: Full-Length Journal Articles — Ten Agricultural Subject Matters, 1967-1969 24 Illinois Rank by Subject Matter Areas — Peer-Edited Journals ... .25 Study III: The Thirty-Year Research Productivity of the Illinois Station, Fiscal Years 1949-1978 30 Variations in the Nature of Agricultural Research 31 Number of Staff 33 Financial Support 33 Number of Publications 35 Publications per Scientist 35 Publications in Relation to Operating Investment in Research .... 38 Corollary Changes Within Science as an Enterprise 40 Statistical Treatments of the Data 42 Time Trends in the Efficiency of the Illinois Station's Publication Output 45 Outlook for the Future Publication Productivity of Agricultural Scientists 47 Dependence of Publication Output on Dollar Investments 48 Variations in Level of Investment in Agricultural Research 49 Federal: Hatch and Mclntire-Stennis 49 State 50 Intrainstitutional Allocation of Funds . 50 Public Examination Necessary 51 Agricultural Research Necessary to National Welfare 52 Lessons From the Illinois Study 52 Publication Records as Indicative of Benefits From Research 54 Public Examination — Invasion of Privacy? 56 The Problem for the Public 57 References Cited 58 Appendix: Raw Data for Study He 60 Publications in 66 Peer-Edited Journals, by Subject Matter for All Stations, 1967-1969 61 Peer-Edited Journals Used in Study lie 62 Urbano, Illinois July, 1980 Publications in the Bulletin series report the results of investigations made or sponsored by the Experiment Station. The Illinois Agricultural Experiment Station provides equal oppor- tunities in programs and employment. Research Productivity of the State Agricultural Experiment Station System: Measured by Scientific Publication Output G. W. Salisbury, Director Emeritus Illinois Agricultural Experiment Station This appraisal of research productivity is intended as an accountability report to the public of use since 1945 of tax dollars by the Illinois and other state agricultural experiment stations in the continuous endeavor to provide a technology insuring that adequate food and fiber can be supplied by all of agriculture. The report deals solely with making pub- lic the results of the research investigations that the public sponsors. It leaves to others the assay of benefits to the public from the develop- ment and application of the resulting technology. The agricultural research system in the United States and its cor- ollary system for informing agricultural producers and others who use agricultural information of its findings are probably the best combina- tion in the world for the purpose. It would be an enormous task to review the accomplishments of that research, but serious students of the situation agree that the returns from such research have exceeded by many times the amounts invested in it and that huge benefits to all parts of society have accrued from the work. The achievements of the Illinois station alone would make an impressive list. The purpose of agricultural research has been to improve the tech- nology used in the production, harvesting, processing, marketing, de- livery, and utilization of food and fiber crops to the benefit of rural life and the economic welfare of the consumer. Since the establishment in 1875 of the first state agricultural experiment station in New Haven, Connecticut, the industrialization of America and the expansion of its economic system have profoundly changed commercial agriculture and its role in America. Today, it not only produces sufficient basic food and fiber items to meet our own needs but it is a major producer of exports, partially offsetting the enormous negative trade balance for foreign oil. Because the research is designed for such a practical purpose, the results of research from the beginning of the system have tended to be published in journals and other sources that are readily available to the 8 — BULLETIN NO. 762 industry (20*), resulting in some isolation from a readership by other scientists in biology and medicine (23). Some of the societies or associa- tions designed for exchange of information and publication of research with agricultural crops and animal species have existed for years and antedate many of the present more commonly recognized scientific journals. There has resulted an enormous, basically rich scientific litera- ture largely unexplored by scientists outside the field. Although the overall utilitarian quality of the work has been recog- nized, there have been few techniques available for measuring the rela- tive effectiveness and efficiency of individual elements of the research establishment. It is relatively easy to evaluate the performance of an individual scientist, and it is easy also to identify scientific "stars" in an organization. But administrators have found it more difficult to measure the quality of their staff against that of others doing similar work. One practical measure that can be used is the publication of scien- tific papers. Publications are usually the only tangible and readily quan- tifiable immediate products of research. Acceptance of an article for publication in a journal, especially a journal published by a scientific society or association of scientists, usually involves careful review of its scientific merit by a committee of peers. This kind of peer review sets a floor for the scientific merits, techniques, and objectivity of the work reported in the paper, although it cannot vouch for the accuracy of the data presented or for the validity of the conclusions drawn. Publication of scientific papers is the measure used in the studies reported here of research productivity and efficiency at the Illinois Agricultural Experiment Station. Two of the studies compare Illinois with other experiment stations and one is internal to the Illinois station. The Agricultural Research System in the United States The Illinois Agricultural Experiment Station is a part of a system unique in the world for generating and distributing new knowledge about agriculture and rural life. Every social and political system through history has given some attention to agriculture and food and to scien- tific study and application of new knowledge to improve and maintain the food supply. Other nations preceded the United States in setting up publicly supported experiment stations and others established federal bureaucracies to deal with agriculture, but no nation put them together with a formal and informal educational system in such a manner and *A11 such numbers refer to "References Cited," later in this publication. PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 9 with such resources as the United States to generate opportunities for the common man to own land and provide him the ability to farm it. The system was begun by Congress during the Civil War and expanded with the cooperation of state legislatures (13). Each unit of the system was established in response to different priorities set by society as it grew. During the twentieth century we have seen increasing research by industries related to agriculture, often emphasizing the development of an idea for operational production systems and use of their own products. The Land- Grant System. In 1862 Congress through the Morrill Act assigned ownership of government land to the states to develop colleges of agriculture and mechanic arts. The University of Illinois was established under this act on March 2, 1868. U.S. Department of Agriculture. The present USDA grew out of an agency established in 1862 to work for the improvement of agricul- ture throughout the country. Its functions have been extremely varied over the years, but it has contributed to the development of research through research centers, regional laboratories, and cooperation with state and other agencies. State Agricultural Experiment Stations. The Hatch Act in 1887 established agricultural experiment stations at the land-grant colleges. At that time few agriculturists were familiar with the principles of scientific agriculture, and the new land-grant schools were not yet equipped to make substantial contributions to agricultural science (23). The Hatch Act was passed to educate and equip a corps of scientists to learn what to teach about agriculture and rural life ( 13). On its establishment in 1868, the University of Illinois was man- dated by the Illinois legislature to conduct research with and for farm- ers. Its administrators became leaders in the national movement to establish in each state some formal organization for agricultural re- search. The Illinois Agricultural Experiment Station was formally es- tablished at the University of Illinois on March 21, 1888, soon after the Congress passed the Hatch Act. Publicly supported research is conducted by it and 51 other state stations (two states have two each), by stations in Puerto Rico, the Virgin Islands, Guam, and the District of Columbia, by the U.S. Department of Agriculture, and by other non-land-grant universities. Under the Hatch Act and other acts passed by Congress relating to agricultural research, the federal government supplies some money to each state for agricultural research, of which any amount above a spec- 10 — BULLETIN NO. 762 ified minimum must be offset dollar for dollar by state funding. In Illinois approximately 35 percent of the funds expended by the experi- ment station comes from federal appropriations (of which about two- thirds are Hatch and Mclntire-Stennis allocations), and nearly half from the state of Illinois. The balance comes from gifts, grants, con- tracts, and other sources. Extension Service. Unlike most industrial technology, the tech- nology that supports agricultural production often must be tailored to the specific needs of individual farmers with unique production cir- cumstances and capabilities. Such tailored technology must come from principles developed by research done in the regions and states where it is to be used. That is one of the great strengths of the state agricul- tural experiment station system. Although not responsible for conducting research, the cooperative extension services have been a key link in getting the results of research to those who can use them and in the sort of tailored form needed by individual farmers. In 1914 Congress enacted the Smith-Lever Act, which established extension services in agriculture and home economics at each state land-grant college of agriculture. Extension people gather research results, deliver the results to the people who can use them, and often help the people organize to put them to use. They also bring back problems from the field for researchers to work on. At Illinois re- searchers often take part in extension activities and report their work in a down-to-earth form to those who can apply their results. Some primarily extension faculty members hold part-time appointments in the agricultural experiment station. Cooperative Research. All states, including Illinois, do much re- search in cooperation with other agencies. The states of the North Central Region, of which Illinois is a member, and the U.S. Depart- ment of Agriculture cooperate in regional research, examining problems for which a multi-state basis can give a better answer. In fact, Congress stipulated in 1955 that above an amount permitted originally by the act of 1946 that initiated regional research, up to 25 percent of all increases in Hatch funding beyond that date should be expended in regional research. The Illinois station also cooperates with agricultural industries, which support some of the research by unrestricted gifts, by contract, or by grants in support of research proposed by a station investigator. Other state agencies, like the Illinois Department of Agriculture and the Illinois Natural History Survey, also work with the Illinois Agricul- tural Experiment Station. PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 11 Organization of Research at the Illinois Station The Agricultural Experiment Station is one of four major divisions of the University of Illinois at Urbana-Champaign College of Agricul- ture. The director's office coordinates all matters relating to the research of the college, prepares budgets, maintains liaison with the U.S. Depart- ment of Agriculture and with other administrative units, and makes reports of its activities and progress. The research is done in twelve research units, all but two of which are in the College of Agriculture. Scientists are staff members of their own particular unit. The units include: Department of Agricultural Economics Department of Agricultural Engineering Agricultural Entomology, a part of the Illinois Natural History Sur- vey but receiving some Agricultural Experiment Station support Department of Agronomy Department of Animal Science Department of Dairy Science Department of Food Science Department of Forestry Department of Horticulture Department of Plant Pathology School of Human Resources and Family Studies (formerly known as the Department of Home Economics) Veterinary Research, an organization in the College of Veterinary Medicine receiving support for certain research functions from the Agricultural Experiment Station Each funded research and the experiments, investigations, or sur- veys undertaken for it are done on a project basis. The proposal for research originates with a principal investigator who, from his or her background and experience and his or her interactions with other scien- tists and colleagues in the extension service, decides that a particular problem is worth pursuing. Procedures, approvals, assignment of fund- ing, and business and reporting operations conform to long-established requirements of the University of Illinois, the Illinois state government, the wishes of the grantor if private funds are involved, and the U.S. government if its funds are to be used. Federal funding may emanate from many different agencies and under many congressional bills en- acted over time, so the rules vary widely. However, since the original Hatch enactment, most of the federal support to agricultural research has traditionally been a direct grant under that act to the director of the 12 — BULLETIN NO. 762 state agricultural experiment station for study of local problems. The amount of funds has been allocated to each station on the basis of the ratio of rural and urban population and has little relation to the im- portance of the state's agriculture. From 1946 to 1975 for the Illinois station, the proportion of the total station's expenditures furnished by Hatch funds averaged 17.7 percent. In 1978 expenditures from state appropriations were about 2^ times the Hatch appropriation, which Congress requires must be, at least, matched dollar for dollar above the minimum of $90,000 it provides. A requirement common to all federal allocations, however, is that the agency must approve the nature of the research and often the procedures to be used in resolving the problem; an audit review and approval of all expenditures are always required. Other federal support of university research is by grant or contract. With contract support, arrangements are more formal and binding on the work to be performed, often stipulated to the last detail. Most such government allocations for research at universities are awarded to indi- viduals or teams of investigators on a project basis, and to the univer- sity employer of the scientists solely for the purpose of the approved project. Proposals for research projects to be supported in whole or in part by Hatch or Mclntire-Stennis funds (both federal funds) must, by Washington insistence imposed over time, go through a review process that includes review by peer groups within the department or research unit, approval by the head of the department or unit, submission to the director's office, additional review by that office, approval by the director, and finally review and approval by the state station research monitoring arm of the U.S. Department of Agriculture. The process is time-con- suming but effective in centralized top-level bureaucratic control. It establishes a collaborative decision assuring that the research will meet a common need and will use techniques recognized by other scientists. However, the process means that the scope and duration of the research are likely to be reduced below the researcher's request, that new ideas or approaches are likely to be squeezed out, and that the research won't be as much fun to do. It is the perfect formula for the bureaucratic "dead hand on discovery" described by Darlington (7) and an entrapment only the most adroit of state station directors can avoid. It is easiest to resist when state and gift funds clearly outweigh federal funds ! An important useful service provided the state stations is the USDA's system of on-site review of departmental or subject matter research progress. Earlier this was done annually by the USDA's Office of Experiment Stations, more recently by the Cooperative State Re- PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 13 search Service on a four-year schedule, and since 1976 by the USDA's Science and Education Administration-Cooperative Research (USDA- SEA-CR). Under the present agency specifications, a team of subject matter research specialists led by an employee of the federal agency but made up otherwise of peers in the subject matter examines in detail the research in progress. Before leaving the site after three or four days of examination, the team reports to the department or subject matter group and the station administrator its views of strengths and weaknesses of the program of research and its effectiveness. Later it files with the station and the USDA a written report of its findings. Such review teams are meticulous in avoiding ranking of stations as we attempt to do here. Scientific Publications as a Measure of Research Productivity In considering the number of articles published by an institution to be an index of its relative productivity, one must assume that the mill- run average of scientific and practical significance of the papers pub- lished is about the same for each institution studied. One can question the validity of such an assumption. Still, that is more likely to be the situation for scientific manuscripts subjected to review by editorial committees of peers before acceptance than it is for manuscripts not so reviewed. The review process places a floor for the level of merit for that particular journal. There obviously are real differences in the scientific excellence or ultimate practical significance of the large numbers of papers published in the various subject matters of science pertaining to agriculture. The problem is that there is no practical way to make objective evaluations now or to assign acceptable numbers to any value judgments that are made. Attempts have been made to assess economic returns on in- vestment in a broad program of research on a single commodity (3, 4, 9, 10, 16, 21, 22, 29), but to assess the contribution of an individual paper requires a time lag of years, by which time the value of the assessment as an aid in deciding about investment in particular research will have passed. Because of the large number of publications included in this study, it is reasonable to assume for any station or research unit that excep- tional research reports are balanced by mediocre ones, that the peaks and valleys level out. Although far from perfect, the system of counting publications has been probably the only practical way for the Illinois station to make comparisons. It is true that some institutions may be 14 — BULLETIN NO. 762 more strict than others in what they will consider and report as a scien- tific publication; this fact may result in some aberrations, but we do not think it skews the data appreciably. Source of National Data on Publications Output The major source of data from the states was the annual summaries prepared by the USDA Office of Experiment Stations for 1945-1959 and by the USDA Cooperative State Research Service for 1960-1975 (1, 2). Each station reported annually its technical journal articles, bul- letins, circulars, and similar output of the station. Only the number of technical journal articles published was used in our study as evidence of scientific productivity. There were some blanks in the data when a station failed to file a report with the USDA (as Illinois failed to do in some years before 1950 because of a dispute between Illinois and the USDA). National average salary levels, staff numbers, funding, and total funding sources were also part of the OES and CSRS reports. Those data did not deal with individual subject matter fields and did not at- tempt to compare and rank the stations accordingly. Study I: A Review of Station Publication Numbers Reported by OES and CSRS This review of experiment station productivity began with an analy- sis of the OES and CSRS annual reports from 1945 through 1975. * The annual number of technical journal articles was compared with the number of scientific workers at each station and with the federal and state dollars allocated annually for research at the stations. Total investment in research at the state agricultural experiment stations was 18 to 20 times as much in 1975 as in 1945, but the purchas- ing power of the dollars declined steadily during the period (Fig. 1). In terms of constant value dollars (15), the investment by the federal government and the state increased about 7^/2 times in the period. Fund- ing per scientist increased and the number of scientists more than doubled. Publications by all stations increased throughout the period in a fairly consistent relationship to constant-value dollar inputs. *In the OES and CSRS reports, years are fiscal years; fiscal year 1946, for example, ran from July 1, 1945 through June 30, 1946. In 1977 the new title for the USDA agency for relations with the state agricultural experiment stations became Science and Education Administration-Cooperative Research (SEA-CR). It discontinued reports of total funding and publication output of each state station with the 1975 fiscal year. PRODUCTIVITY OF STATE EXPERIMENT STATIONS — IS Index U.S. Agricultural Experiment Stations (1945=1) 70 75 Figure 1. Indexes of changes in funds, staff, and publication output for U.S. agricultural experiment stations, 1945-1975. Index Illinois Agricultural Experiment Station (1945 = 1) K^. '"» Constant fe o * c~ n"rt " w co £ U O*O *O i ™ 3 •>*"•" S 2 .y.o CL, o c3 -S 8*8 11 11 1 !« l •n ~>5, S 0.2 " § 0) B S i !2 aj O •— C .t-j •S3 " HH A „ •Z!3.O w ^ ^gs- c/f'S C •2 -3 4J y id *5* ^ .0 j» £ ^* 3 'S •*-» CT} 3 4> S M 'o p^ . -a vOOp PO^O PO rr >O •— ' o--i oooo •— i O ^4" O < PO--H ^1 ^J >-<000000 S IPO PO >IO OO ) O S ivo POOO> IOO •— iTt< I «— I I— 1 1>. < OPOPON «-i • 3 CO box « c u 'o . 00 iu S« »3 & .y ll 1= o §5 tea e v l.s S-2 3332 It V*S 5 o^1-- ,°.y.y § E ""^Ta o c'-S •" S "rt hnh/lh/lhn'S'rtSi? : art's "n JSl bo bo bo bo PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 37 llcations in 66 journals, we had for each station corollary data on the number of scientist years and the number of federal and state dollars invested in 1967, 1968, 1969, and 1975. The same kinds of analyses were contemplated for the Illinois output for the entire period 1948-1978. On investigation, however, it was found that, while the percent of each scientist's appointment in the Agricultural Experiment Station was recorded in the archival budget books of the University of Illinois, no annual summaries of scientist years by departments were available earlier than for fiscal year 1965, as then stipulated by CSRS for its publication of annual data from the state stations. By recourse to the earlier annual budget books, the number of scientist years (full-time equivalent, or FTE under the University of Illinois system) back through 1948 could be laboriously dug from the records but that has not been done. The writer has, however, compared the station records and the bien- nial report listing of staff head count for the seven bienniums 1964- 1978, to find the relationship of professorial head count and FTE for the several departments and a school as follows: FTE is of head count (%) Agricultural Economics 44.0 Agricultural Engineering 52.8 Agronomy 63.4 Animal Science 59.5 Dairy Science 68.3 Food Science 63.4 Forestry 52.5 Horticulture 63.2 Human Resources and Family Studies 31.9 Plant Pathology 74.7 The fractional full-time-equivalent appointments of the senior staff varied significantly from unit to unit but the relation one to another remained relatively consistent for the seven bienniums. The bias involved in comparing publication output of the units on the basis of head count is obvious. Still head-count data for the first eight bienniums are all that are readily available. Use of these fractional coefficients for "correction" of the head count for all 15 bienniums pro- vided no better precision in interpretation of the findings of the relation- ship of publication output to total funding from biennium to biennium than did head count. When calculated, however, on the basis of funding per scientist within departments for the last seven bienniums a consis- 38 — BULLETIN NO. 762 Table 9. Publications per Senior Staff Year, by Head Count, and by FTE 1948-1978, by head count 1964-1978 By head count By FTE Station- reported articles per staff year Peer- edited articles per staff year Station- reported articles per staff year Peer- edited articles per staff year Station- reported articles per staff year Peer- edited articles per staff year 1 Agr. Econ. .. 2 Agr. Eng. ... 3 Agr Ent. . . . . 1.36 . .99 .42 .59 1.09 1.69 1.18 1.38 .61 .43 1.16 2.58 1.82 1.59 1.52 1.74 3.17 2.82 1.53 1.74 1.03 3.05 4.61 2.86 .56 .92 US 1.88 1.27 1.08 .71 .38 1.64 3.35 2.05 3.52 2.81 2.73 5.19 4.01 2.35 3.37 3.13 5.76 6.06 1.23 1.70 £ii 3.09 1.84 1.98 1.35 1.16 2.56 4.11 4 Agronomy . . 5 Animal Sci. . 6 Dairy Sci. . . . 7 Food Sci. ... 8 Forestry .... . 1.42 . 2.78 . 2.52 . 1.57 . 1.61 9 Hum. Res. and Fam. Stud." . 10 Hort .89 . 2.27 11 Plant Path." . 12 Vet. Res. . . . . 3.62 . 2.47 •The Department of Home Economics became the School of Human Resources and Family Studies in 1974. b Plant Pathology combined with Horticulture for 1948-50 biennium. tent pattern for most of them emerged. There was, of course, in some instances a decrease in the statistical significance of differences result- ing from the decrease in degrees of freedom for the analysis (see Tables 10 and 11). Clearly for the long pull annual records of the FTE research appointments of the senior scientists of each department and research unit should be kept by the station office. The means of departmental and research unit publications per scien- tist for 1948-1978 based on the head count and for the last seven bien- niums based on both head count and the fractional FTE are shown in Table 9. It is the opinion of the writer that the true potential of any scientist in a field is far short of what might be suggested if the ac- complishments of a part-time appointment for research are extrapolated to a full-time appointment. Research on difficult problems is an absorb- ing and preoccupying task. It is highly doubtful if there is twice as much time for thought, study, and speculation on a full-time appointment as occurs among the better scientists on a half-time research appointment. Publications in Relation to Operating Investment in Research We also considered the dollar investment for the 30 years in rela- tion to total reported publications. During the 30 years, the Illinois staff published 12,546 papers and expended a total of $156,775,483.40 (Table PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 39 9). Thus the average operating investment in every paper published was $12,4% or $20,696 if only peer-edited journal articles are counted, or $38,397 if only articles in the 66 selected journals are counted. The data, however, should not be compared with present-day Illinois data. Because they are averages over a long period and because of the general infla- tionary trend for the period, they are far more characteristic of the early 1960's than of the end of the period. The inflationary index for institutional costs of research and devel- opment was 196.56 for fiscal year 1978 as compared with 100 for fiscal year 1967. The lines of actual and constant- value dollars thus cross at a point early in the tenth biennium, not in the eighth which is the mid- point of this time series. A few more than half of the total publications had been reported by the end of the ninth biennium. For fiscal year 1979 the price index was 216.51, and for fiscal year 1980 it will be no less than 240. Prospects are that it will go even higher for fiscal year 1981 and later. Thus these cost figures must be doubled or more for estimates of necessary present investments. The estimates for publication costs for Veterinary Research and for Agricultural Entomology were seriously biased to the low side because not all their costs were in the experiment station. Those two units are therefore omitted in some of the following comparisons. The lowest average investment per paper was for the Department of Plant Pathology at $7,404. The highest was in Food Science at $21,212. There are logical reasons for such a variation. Both departments were created at about the same time from parts of other existing departments. The Illinois Department of Plant Pathology was one of the official latecomers (1954) to a field long established and traditionally accepted as an area of investigation and teaching. The de- partment was largely formed by bringing together small units that had been a part of other departments, and the plant pathologists were able to go right on with what they had been doing. Peers are not likely to pre- judge the significance of finding a new disease anywhere, and the out- break of an old enemy in a new location under new environmental cir- cumstances had equal significance. Thus rules of publication behavior in the field and standards have long been established in plant pathology. The standards are not any easier to meet than in other areas, but they are easier to recognize and to teach. The emerging field of food technology, however, required larger investments in equipment for processing food, other than that derived from milk, and in other scientific and technical equipment necessary for research in human nutrition than Plant Pathology required for its work. As a newcomer to an expanding field where only a few departments had 40 — BULLETIN NO. 762 been created earlier, the publications of scientists in the new department of Food Technology (now Food Science) faced higher hurdles for ac- ceptance in peer-edited journals than became customary as the field rapidly developed to its present dimensions. The number of dollars allocated to the departments and research units for four different bienniums is given in Table 7. Regardless of the trends evident in that table, station investment per publication though highest in the 1976-78 biennium increased relatively slowly, and showed no consistent pattern among departments. The output of sta- tion-reported publications increased at a rate of 76 publications per bi- ennium over the 30-year period. There is highly significant statistical evidence, however, of a declining rate of increase in publication output over the last decade. To maintain the 30-year trajectory of increased station publication output would require the addition of 1.37 staff members and $46,040 to an average department for each additional paper published. But of course there is no average department; each is unique. Differences are due to inherent differences among the persons making up the contingent, to their different backgrounds and motivations, to the uniqueness of subject matter and the nature and degree of responsibilities they assume or have been assigned in the practical world, to the expectations and degree of support of their public clientele apart from students, to the financial and other facility support provided by their home institutions, and to the creative, zestful, and mutually supportive atmosphere of their institutions. Corollary Changes Within Science as an Enterprise Many others, too numerous to cite in a publication of this nature, have been concerned with the recent history of the expansion of science as a full-blown enterprise of modern man — as an industry of today's culture for assuring human progress. Most of the resulting papers and discussion have dealt with physics and the basic understanding of that field and chemistry. There have been few publications about the applied fields, especially agriculture. The most detailed citations and valuable contributions are to be found in a book by Nicholas Rescher (19) of the University of Pitts- burgh. Published in 1978, it is a philosophical essay on the economics of research in natural science. It is a thought-provoking discussion of sci- ence, its acceleration in its rate of growth and productivity of the recent past, and the seemingly inevitable deceleration which will result from the fact that the problems faced are more difficult and expensive of inputs PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 41 to resolve. Dr. Rescher details for basic science the facts of its relatively recent exponential growth and productivity. He describes how that ex- plosive growth is being dampened by the increasing complexity of basic problems, and the difficulty of marshaling the total resources necessary for their resolution, including the maintenance of the quality of those inputs, so that scientists are likely approaching an asymptote in the rate at which discoveries will be made for understanding the complexities of natural phenomena. He presents views and theories advanced by some of the great leaders of science about these issues and about whether the principles to be learned from the scientific method are limited or limit- less; he believes they are limitless, but presents theory and evidence to suggest that the deceleration of accomplishments in basic science is at hand. Even though science will continue to make great contributions to understanding nature, leading to its control for the benefit of man, such progress will occur at a slower rate and at increased cost. Parallels in the applied sciences are revealed in the studies reported here of research productivity in state agricultural experiment stations. Total funding for such research grew since the end of World War II through 1975 at a compound annual interest rate of 10.4 percent, though the contribution of the federal government was a bit lower, 9.7 percent. This exponential increase has resulted in a doubling of the actual dollars appropriated by the individual state and federal governments of appar- ent funding for agricultural research every seven years. Inflation and the consequent reduction in the power of each dollar to purchase the collective resources necessary for agricultural research have reduced that apparent recent growth in agricultural research to a much more modest average increment of not quite 5 percent per year, equivalent to a doubling of constant-value dollars each 15 years or more. Illinois has not done as well as the nation as a whole. Still the actual cost of station operation for each paper published did not increase as fast as one might have expected. Science too has its own technology, and this suggests that throughout the period of study the application of that technology and its efficiencies introduced in agri- cultural research were counterbalancing the increased complexities and difficulties of the problems studied. For the natural scientists in the station, the applicable technologies include those enabling them to con- trol environmental conditions surrounding their material, new instru- ments with several powers of increase in perception and measurement of natural phenomena, and new techniques and methods for processing and interpreting their data. Modern computers and even electronic cal- culators under this last category were, of course, of infinite value, espe- cially to the station economists but to most others as well. 42 — BULLETIN NO. 762 The improvements have enabled agricultural scientists to tackle the complexities of their subject matter in a manner heretofore impossible. They have been able to redesign and conduct experiments relating to questions long asked in their fields, to generate data involving deliberate control and measured interactions, and to analyze their findings to an understanding which was primarily only highly speculative but a few years earlier. Agricultural scientists seek fundamental knowledge of how to bring the parts of a very complex system together to increase the effectiveness of provisioning people. This is, of course, the reason for the involve- ment of specialists from several basic intellectual fields in the basic in- teractions of the endeavor, those of the physical and biological systems of nature in the production of useful, healthful commodities with the energy, distribution, processing, economic, and political systems of the world. Statistical Treatments of the Data As we have accumulated these data over recent years, we have from time to time subjected them to detailed multivariant statistical analysis. The presumed independent variables tested as potential influences on publication output were the department or research unit, bienniums, staff size as head count and scientist years (FTE), and actual and con- stant-value dollars (adjusted by the Sonka-Padberg cost-of -doing-re- search index (26) ) allocated to each department or research unit. The first analysis for the data accumulated over 13 bienniums indicated that the rate of publication output at the Illinois station was beginning to slow down, which suspicion was verified by the analysis of the data accumu- lated for the 14th and 15th bienniums. These data have been subjected to many different probings, but they are in fact limited and not capable of much valid manipulation. It was early recognized that the information bits are not independent one from the other. Inflation did not occur randomly among the 15 bienniums but followed a consistent upward time trend; so too did changes in staff size, total funding, and publication output. The multicollinearities were studied by calculation of the Durbin- Watson d statistic and inappropri- ate regression models so revealed abandoned. This simplification raised the issue of homogeneity of variances of the data within departments and bienniums. Tests of heteroskedasticity, or heterogeneity, of vari- ances revealed significant differences for Agronomy, Horticulture, Plant Pathology, and Veterinary Research. Corrections of these data PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 43 resulted in no departmental position change or judgments about the basic inputs necessary for publication output. The analyses were conducted including and eliminating the two atypical research units of the station, Agricultural Entomology and Veterinary Research. When these two units were eliminated from the Table 10. Rank Order of the Illinois Agricultural Experiment Station Departments and Research Units in Publication Output Tested by Various Statistical Adjustments and Their Significance* — for Station-Listed Publications IS bienniums (1948-1978) Adjusted for staff head count and Dept. or Rank unit Mean per biennium Actual dollars, dept. or unit Const, val. dollars, dept. or unit 1 2 3 4 5 6 7 8 9 10 11 12 Animal Sci . 137.7 A Agronomy Animal Sci. Agr. Econ. Hort. Dairy Sci. Food Sci. Agr. Eng. Vet. Res. Plant Path.' Forestry Hum. Res and Fam. Stud. Agr. Ent. A AB AB AB AB AB B B B B B B Agronomy Animal Sci. Agr. Econ. Hort. Dairy Sci. Food Sci. Agr. Eng. Vet. Res. Plant Path.* Forestry Hum. Res. and Fam. Stud. Agr. Ent. A AB ABC ABC BC BC BC BC BC BC BC C . . 125.7 AB Hort . . 97.8 B Agr. Econ . . 89.1 BC 86.4 BC Plant Patkb .. 79.8 BC Vet. Res .. 72.7 C Food Sci , , . 50.3 D Agr. Ent. 32.9 E .. 32.5 E Aer. Encr. . .. 31.7 E Hum. Res. and Fam. Stud.* .... .. 15.8 E 7 bienniums (1964-1978) Adjusted for FTE and Dept. or Rank unit Mean per biennium Actual dollars, dept. or unit Const, val. dollars, dept. or unit 1 2 3 4 5 6 7 8 9 10 11 12 . 184.0 A Agronomy Agr. Econ. Animal Sci. Hort. Food Sci. Dairy Sci. Plant Path. Agr. Eng. Forestry Vet. Res. Hum. Res. and Fam. Stud. Agr. Ent. A AB AB AB AB B B B B B B B Agronomy Animal Sci. Agr. Econ. Hort. Food Sci. Dairy Sci. Plant Path. Agr. Eng. Forestry Vet. Res. Hum. Res. and Fam. Stud. Agr. Ent. A B B B B B B B B B B B Animal Sci . . . . . .. 174.7 A Hort . . 144.0 B Agr. Econ. .. 122.3 BC Plant Path.' . 106.9 CD Dairy Sci .. 100.3 CD Vet. Res . . 89.4 D .. 61.6 E Ajrr. Ene. . 49.4 EF Agr. Ent . . 48.7 EF . . 47.6 EF Hum. Res. and Fam. Stud . . 22.0 F • Departments or units followed by the same alphabetical characters are not significantly dif- ferent at the 0.05 level of P. b 12 bienniums. e The Department of Home Economics became the School of Human Resources and Family Studies in 1974. 44 — BULLETIN NO. 762 total station analysis, the colligated results for the station as a whole were more precise, the standard errors of coefficients were smaller, and the coefficients of determination (R2) for the regression analysis were larger. However, those research units were an important part of the overall station research program, being all of the so-called large animal Table 11. Rank Order of the Illinois Agricultural Experiment Station Departments and Research Units in Publication Output Tested by Various Statistical Adjustments and Their Significance* — for Peer-Edited Publications 15 bienniums (1948-1978) Adjusted for staff head count and Rank Dept. or unit Mean per biennium Actual dollars, dept. or unit Const, val. dollars, dept. or unit 1 2 3 4 5 6 7 8 9 10 11 12 Agronomy , 96.5 A B C C CD D D E EF EFG FG G Agronomy Agr. Econ. Animal Sci. Hort. Dairy Sci. Food. Sci. Agr. Eng. Vet. Res. Plant Path. Forestry Hum. Res. and Fam. Stud. Agr. Ent. A AB AB BC BC BC BC BC BC BC BC C Agronomy Animal Sci. Agr. Econ. Hort. Dairy Sci. Food Sci. Agr. Eng. Vet. Res. Plant Path. Forestry Hum. Res. and Fam. Stud. Agr. Ent A AB ABC BCD BCD BCD BCD CD CD CD CD D Animal Sci. .... .. 83.7 Plant Path." .... .. 57.1 Vet Res . . 53.6 Hort , 48.9 Food Sci , . 44.2 ,. 40.6 . . 27.7 24.3 . . 18.9 Forestry . . 12.3 Hum. Res. and Fam. Stud." .. 7.5 7 bienniums (1964-1978) Adjusted for FTE and Rank Dept. or unit Mean per biennium Actual dollars, dept. or unit Const, val. dollars, dept or unit 1 2 3 4 5 6 7 8 9 10 11 12 . 142.6 A B C C CD DE EF EF EF FG GH H Agronomy Agr. Econ. Hort. Plant Path. Dairy Sci. Agr. Eng. Food Sci. Forestry Animal Sci. Vet. Res. Hum. Res. and Fam. Stud. Agr. Ent. A A A A A A A A A A A A Agronomy Animal Sci. Agr. Econ. Hort Dairy Sci. Food Sci. Agr. Eng. Vet. Res. Plant Path. Forestry Hum. Res. and Fam. Stud. Agr. Ent. A AB ABC BCD BCD BCD BCD CD CD CD CD D Animal Sci ..... . . 104.0 Hort . . 77.6 Plant Path . . 75.6 Vet. Res 64.3 ,. 51.7 Dairy Sci .. 450 Agr Econ . . 42.9 37.1 Ajjr. Ene. . . . 29.6 Forestry . 193 Hum. Res. and Fam. Stud 8.1 • Departments or units followed by the same alphabetical characters are not significantly dif- ferent at the 0.05 level of P. b 12 bienniums. c The Department of Home Economics became the School of Human Resources and Family Studies in 1974. PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 45 protection area and a substantial segment of the plant protection work; so reality demanded their inclusion. In actual fact publication output was highly significantly different among bienniums, research units, dol- lars allocated, and number of professorial staff. The R* values for the multivariate regression equations for the station as a whole were about 0.84 when Agricultural Entomology and Veterinary Research data were included in the computations, and about 0.88 when they were not. Either analysis provided F values indicating that the probability of chance causing the overall differences shown was less than 1 in 1,000. Separate analyses revealed that the data for those two research units were atypi- cal. For example, throughout the 30-year period a slower rate of increase in dollar investment by the Illinois Agricultural Experiment Station to Agricultural Entomology led to an apparent increase in publication out- put. Also, from the data available it appeared that the investment neces- sary to generate one paper in Agricultural Entomology was several times higher than in Veterinary Research. Neither of these potential hypotheses makes sense. The historical data from neither source re- flect the actual inputs for the publication output. The results for the two units are what one would expect from a situation in which the lesser contributor of major sources of financial support, with its funds widely distributed over most research of an organization, insisted on approval of and credit for all research in which any of its dollars were expended. It is clearly the result in this case of historical accounting and reporting procedures adopted by this station and this university when times were more gracious and the consequences of the procedures less potentially damning. Time Trends in the Efficiency of the Illinois Station's Publication Output Research publication output of the Illinois station responded to the increase in effective funding of equivalent-value constant dollars by an acceleration in numbers from 1948 through 1956. At that point the rate of biennial increase in publication output per constant-value dollar of investment dropped in a decline persisting for six years. In the next biennium, 1962-64, the relative research output per dollar unit of investment began an ascent which terminated in its high- est value in the 30 years during the 1974-76 biennium (see Fig. 4). The reasons for the marked burst of output after World War II and then the sudden drop in the efficiency of publication output by the Illinois station senior scientists beginning with the 1956-58 biennium 46 — BULLETIN NO. 762 are not apparent from the data on funding and staff size, nor is there other readily available, recorded evidence pertaining to the situation. As one on the scene at the time, however, it is the opinion of the author that the increase was due to the enthusiastic return to research by the senior scientists, the full professors, who, though on the job, had turned to other tasks and academic responsibilities during the war when the assistant and instructor ranks had been almost completely eliminated. That burst of output continued for a time by provision of apprentice help from aspiring returned veterans until retirements and other attri- tion concentrated in the mid-1950's reduced the number of senior ex- perienced and competent professors. A period of time sometimes quite extended was required for the personnel hired immediately after the war to complete advanced degrees and to prepare themselves for serious research while engaged primarily at the time in teaching the large num- bers of returning veterans seeking a university education. That drop in Million Publications per constant million dollars Number of publications alue lollars 2 — 70 — 60 50 Constant / % value . •— •' \ A d°iiarsx. ./ :^v \ A y / ^ / * / .--• NS» / \ >• /* Peer- edited / *vv f / publications / V». S per million dollars 7 / ,-•••"""•%- ^ ,<""" - «,******•• •••••••* Peer-edited j? publications -X Illinois Station 1 , I , I , 1 , 1 , I , 1 . I 6 — 40 — 30 20 10 0 750 500 250 48-50 52-54 56-58 60-62 64-66 68-70 72-74 76-78 Biennium Figure 4. Constant-value dollars, peer-edited scientific articles, and publica- tions per million dollars for the Illinois Agricultural Experiment Station from 1948 to 1978. PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 47 research productivity, persisting for six years, was a belated cost of the war disruption. The publication output reached a high asymptote for productivity for the 1968-1976 period for the combination of staff numbers, dollars invested, and facilities and "atmosphere" pertaining at the station. It decreased significantly in 1976-78. The overall productivity of the Illinois station dropped in the final biennium of this time series from 1,573 to 1,186 total reported publica- tions; a decrease of 387 and a decrease of 140 publications in peer- edited journals from the 1974-76 biennium. It appears that the system of research productivity was pretty well saturated during the 1970's and reached an equilibrium consistent with the value of its inputs. In the analysis of CSRS data for all the state stations, the slope of the annual overall productivity output line was as steep for the 1966-1975 decade as in the preceding two, indicating no general decrease up to then in re- search productivity. However, some of the more prominent and mature stations, and Illinois was among them, seemed to have reached a slow- down, as suggested by a decrease in the regression of technical journal publication numbers on years in the last decade of the 30-year period. The marked decline in the Illinois publication output was not apparent, however, until the 1976-78 biennium. It would be of interest to know whether this abrupt cessation in the latter half of the 1970's of a long string of annual increases in research output was a national phenomenon or peculiar to the Illinois station. A pessimistic hypothesis is that the approach to an asymptote is a general- ized phenomenon and that the decline in output after reaching a maxi- mum may be, also. Our data here would suggest that this is inevitable unless substantial resources are continually added to agricultural re- search. If we are, however, to approach a level of zero growth in all science as others predict (see Rescher, 19), then there will be a slowing of technology inputs to the industry of agriculture and a decrease in the rate of its productivity growth, which has been twice as great as non- farm industry of this country ( 10) . Outlook for the Future Publication Productivity of Agricultural Scientists Experienced scientists and research administrators all believe that there is more to the sum total of research output of a research organiza- tion than simply the number of scientist years and the financial resources invested in it. Reason, too, dictates that this is the case. 48 — BULLETIN NO. 762 In examining this assumption, the fiscal history and production rec- ords of the Illinois station were more useful than the national evidence. The analysis showed that within that one station with its ten (or twelve) subject matter departments or units, its greatly varying investment over the years among those subject matters, and their differences in size and subject matter traditions, the most precise estimation of publication output for a subject matter was the multivariate relationship of the size of the professorial staff devoted to research (FTE) and the number of dollars invested per FTE in the subject matter field. However, such pre- cise data were available only for the last seven bienniums of the Illinois analyses and not at all for other stations. Total dollar inputs are the product of the two. The relative predictive outcome for the two as inde- pendent variables and the single variable of their product as independent was estimated for the limited data of the seven Illinois bienniums for the ten (or twelve) subjects. Subtle differences found between the two analyses among departments did not change the departments' relative ranking to a significant degree; the correlation coefficient between the coefficients of determination for the two procedures was 0.9063. The single independent variable of total dollars available (as obtained from the OES and CSRS reports) as a time parallel in rela- tion to the annual technical journal output of the station was then ex- amined further. Dependence of Publication Output on Dollar Investments During the 30-year period 1945-1975, the annual total available fund- ing of the state agricultural experiment stations in actual dollars as re- ported by OES and CSRS accounted for 68.4 percent (r = 0.8273) of the year-to-year variability in the stations' output of publications in technical journals. This amounted to an average investment over the period of $26,431 per recorded publication of this kind. That figure, because the midpoint year for the publication numbers fell during 1966, would call for multiplication by 2.25 to 2.5 to equate with 1980 dollars. For the Illinois station during a comparable time period, 1949-1978, the average funding available for each of its OES- and CSRS-recorded publications in technical journals was $18,727 and it, too, would require multiplication by 2.25 to 2.50 to update to 1980. The year-to-year varia- tion in the number of actual dollars available to the Illinois station as reported over the years by the OES and CSRS accounted for 76.3 per- cent (r = 0.8737) of the year-to-year variance in its number of publi- cations in technical journals. Relating these latter figures to the actual annual expenditures as given in the 15 biennial reports of the Illinois PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 49 station for the period, at Illinois the mean cost per publication in techni- cal journals was $16,620 and the year-to-year variation in dollars ex- pended accounted for 82.3 percent of the variance in station output of publications in technical journals. As organized and administered during this time span, the availability of dollars clearly had a commanding influence on the productivity of the Illinois and other agricultural experiment stations. The Illinois station has been more efficient in the dollar cost of its OES- and CSRS-recorded technical journal output than have been the stations of the nation as a whole. Not only has the mean annual cost per publication been lower for the Illinois station than the average of the other stations, but the annual rate of cost increase per publication showed no statistically signif- icant time trend for Illinois and a highly significant one for the nation as a whole of about $650 per year. Variations in Level of Investment in Agricultural Research Viewed in the broadest sense, differences in dollar investments from state to state and within states to different problem areas of agricultural research are a reflection of how the public and its decision-makers view the importance to them personally of agricultural research. The public at large relates only superficially to the many different sequential human tasks in the food and fiber provisioning chain, and those in the majority in the population centers then relate if at all only to the farm production of the raw commodities they see in intercity travel and to food on the retail shelves. The colleges of agriculture early concentrated on agricul- tural production and only gradually have they expanded their own hori- zons, the degree to which they have been involved in research throughout the spectrum of provisioning people being dependent on the population density of the state. Federal: Hatch and Mclntire-Stennis In the allocation of federal dollars to agricultural research, the fed- eral Hatch and Mclntire-Stennis funds are distributed for use by the states' stations by law on the basis of urban and rural population dis- tribution within the states in relation to the national pattern and in such a fashion as to minimize differences in the federal allocation to the states. The top ten states in receipt of total federal funds in 1975 were Texas, North Carolina, Alabama, Mississippi, Georgia, Tennessee, Ken- tucky, Virginia, Arkansas, and Louisiana, the amounts varying from 50 — BULLETIN NO. 762 $6,428,023 to $3,522,883. Each of these states has an 1890's land-grant college in operation. Illinois, with no 1890's college, ranked nineteenth with an allocation of $2,679,199. This concentration of federal funding in the southern region bears little relation either to its agriculture or its agricultural research productivity and is justified on other grounds. State In the state funding of agricultural research, the relative allocations reflect state concerns. The ten leaders in 1975 were California, Florida, New York, Texas, North Carolina, Georgia, Minnesota, Mississippi, Wisconsin, and Ohio, with the levels of all nonfederal funding avail- able for agricultural research varying from $43,581,205 for the leader down to $11,571,510 for the state in 10th position and to $1,799,866 for the last state in order. Illinois ranked 18th with $9,597,288. No predominant and consistent pattern for the state and other non- federal allocation to agricultural research in the states can be dearly demonstrated statistically though the effects of total population, levels of income from agricultural commodities, relative dependence on agricul- ture as an industry, and concern for consumer welfare can all be seen. Illinois, often ranking fourth and sometimes third among the states in income from agriculture, with a heavy population and a great industrial base, and Iowa, usually ranking third among the states in agricultural income but not having any great cities or a major industry base, ranked 18th and 16th respectively in the total state and other nonfederal fund- ing available for agricultural research in 1975. It all apparently makes political sense but not very good survival logic. Intrainstitutional Allocation of Funds Within the land-grant university homes of the state agricultural experiment stations, resident teaching has carried a higher priority than research in the allocation of some resources. Throughout the entire period covered by these studies, this was most apparent in the hiring of professorial staff, although those with a research appointment were likely to have more discretionary dollars. Vacancies in subject mat- ter teaching for the growing numbers of agricultural students were, rightly, filled first. The subject matter of research interest, but not neces- sarily the competence, of the new appointee was secondary. Early in the 1945-1975 period, when the size of both the teaching and the research endeavor was smaller, specification of subject matters to be taught and professorial interest in doing so was probably of greater importance in staff selection than has been the case as the staff size has PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 51 increased. With the increase in size has come specialization and a con- tinuing shift toward basic science orientation of the professorial staff. As the teaching load increased in recent years, tending to lower the pro- portion of the individual appointment to the research function, the num- ber of individuals employed also increased and the number of basic disciplines and technical skills they represent expanded. The teaching load and the greater technical competence of the facilities provided have been the basic reasons why costs per publication, though increasing at Illinois some in the 30-year period, have not increased greatly. As num- bers of college-age students decline during the next decade or so, re- search interests of new staff will play a greater role in their selection. Still, with intrainstitutional hiring and promotion standards of the land-grant universities pretty much determined by interinstitutional trade and consultation (e.g., the requirement of letters of recommenda- tion from peer-group leaders employed at sister institutions for pro- motion to tenured positions) and with the subject matters of research investment pretty largely determined in their objective thrust by the national planning and funding agencies and in their technical thrust by- peer groups, one can believe that the rise in government support of all science, including agricultural science, since World War II has resulted in a commonality of institutional response attuned primarily to dollars. In the opinion of the writer, this trend, in the face of current inflation and public recognition of limitations to world resources for improve- ments in living standards and quality of life, is responsible for the present apathy, if not active resistance, of the public to the continual requests by scientists for increased funding for their specialty. Public Examination Necessary Public examination is necessary of the issues of funding of scientific research of all kinds and of domination by federal agencies of the direc- tions of that research. If, as many students of the problem seem to believe, the health of American science equates directly with the size of the nation's invest- ment in it (12), then the present public questioning presages ill days ahead. Science to be applied in the interest of agriculture is likely to fare no better than and possibly much worse than that relating to other public issues. On the scale of national and individual survival, agricul- ture, even though it produces vital supplies of food and fiber, does not rank very high alongside public health, space, defense, and energy for investments in research, since this nation's productive capacity for some agricultural commodities exceeds our immediate internal demand. 52 — BULLETIN NO. 762 Agricultural Research Necessary to National Welfare Not yet have we, as a nation, fully recognized the tremendous eco- nomic and political role played by our national capacity to produce basic food and fiber in abundance. Not yet have we recognized that the United States cannot indefinitely maintain the present posture of the cornu- copia or breadbasket of plenty for those less fortunate elsewhere unless we invest much more in learning what essential nutrients will ultimately require constant replenishment and how to do so effectively as they are withdrawn by soil manipulation, by erosion, and by long-continuing sale overseas of agricultural commodities from our unappreciated land resources. So far in America's history, research resulting in decreases in necessary labor input to agriculture has accrued to the benefit of farm owners and operators while agricultural research increasing the amount of renewable necessary commodities produced has ultimately accrued to the benefit of the consumer (27). When in the future neither of these outcomes occurs and the struggle is to maintain production and labor efficiency at fixed sustainable levels, the societal benefits from agricul- tural research could be simply basic survival. It is pessimistic and possibly unnecessarily modest for scientists of the field to view the health of agricultural science solely in terms of the level of public investment in it. The public and science in general have been apathetic about agricultural science (24) and some have viewed its isolation as self-imposed (14). Efforts to substain its federal funding have come almost exclusively from within the body of science applied to agriculture and from the isolated industry itself. As the recent Nobel Laureate Professor Theodore W. Schultz and his students have so ably pointed out over the years, agricultural research has paid high returns as a public investment and high dividends in human survival and is basic to fulfillment of dreams of equitable world development (24). Lessons From the Illinois Study It would seem that in this rather detailed analysis of the scientific output of one state agricultural experiment station during a very brief historical time span in which all scientific publication output reached the highest level in world history, there are lessons to be learned. 1. The funding for the Illinois Agricultural Experiment Station in the 1948-1978 period very nearly achieved (the nation as a whole did reach that level) the status of an exponential growth curve; the coeffi- cient of determination for the correlation between the log of the actual PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 53 dollar investments each biennium and the sequential number of the bi- ennium being R2 = 0.9866. The linear relationship between the actual dollars invested and the biennium number was nearly as high, however (R2 = 0.9773), and not significantly different from the log relationship. There is no real likelihood of future indefinite continuation of this steep ascent. The shape of that curve, however, was determined far more, it seems, by the irresistible trends of the American economy and the hu- man population numbers since the end of World War II than it was by a deliberate, planned program for societal investment in science ap- plied to agriculture. In general, past state and federal appropriations for agricultural research have pretty well paralleled one another, with the state appropriations increasing slightly faster. The Illinois station in relation to the agricultural productivity of the state has been poorly supported and thus, as pointed out earlier, more dependent for its rela- tive agricultural science position among the states on federal funding than on state funding. Much has been said in federal appropriation hearings during the past 30 years about support of agricultural science, but as has been well put by another ". . . there is about much that comes out of the govern- ment's writing apparatus, an air of unreality, in which words are used so as to mean as many things to as many people as possible" (11). Little was said in the Illinois legislature or in public debate about the health of Illinois's own agricultural science during the 30-year period until 1977 when in the face of an approaching decline in the state's population of school-age children, the state began planning for new long-term educa- tional objectives. 2. The Illinois Agricultural Experiment Station already has experi- enced the inevitable funding decline in purchasing power, which has been paralleled by a decline in the rate of publication output and for one biennium at least in an actual decrease in publication numbers. One cannot be sure that the decrease in station output in 1976-78 from the high of 1974-76 logically can be attributed to parallelism of funding, and station output though given great credence in these studies cannot be depended upon as proof of cause and effect in one biennium. The slowly withering effect of the decrease in purchasing power of the dol- lars invested in agricultural research treats agricultural research no differently than it does all of American science and much of the Ameri- can population. 3. In the author's opinion it is more than likely that the decrease in publication output we are witnessing is also the effect of the increasing basic difficulty in the problems tackled and of the passing of that great 54 — BULLETIN NO. 762 and splendid body of dedicated scientists who elected to join agricultural academe after service in World War II. 4. In this 30-year period we have witnessed two peaks of research publication efficiency (peer-edited papers per unit of constant- value dollars) twenty years apart and not too different in height, which sug- gests that they may reflect one complete cycle in the human endeavor of an agricultural experiment station. The twenty-year span is a bit short for an average human generation interval, but when considered as the turnover interval for the veterans of World War II whose advanced degree studies were delayed so that they joined academe five to ten years later in life than the present newcomers, the parallel may fit. If that in fact is the case, then we may expect a period of reduction in the efficiency of the Illinois station followed in time by a recoup of productivity. The nature and extent of that recoup and the speed of the recovery are tied to the quality and competence of the new people to be chosen as faculty replacements, their training, the nature of the prob- lems they are called on to solve for agriculture, and the adequacy of the equipment and other facilities provided them for the resolution of those problems. Publication Records as Indicative of Benefits From Research In the present studies and analyses of several different sources of information about what agricultural scientists do with facts and infor- mation they acquire from the publicly funded research they perform for the public, the author has asked the reader and the paymaster, the pub- lic, to assume that numbers of publications equate with the ultimate down-the-road payoff in public benefits of agricultural research. The author recognizes as he said some years ago, "If printed on cellulose-based paper these publications can be consumed with relish and physical benefit only by ruminants, and other organisms possessing distinctive enzymes for digestion of cellulose," none of which man pos- sesses. Clearly, it is the theories, the concepts, the ideas, and prescriptions those papers proclaim which are of importance to the sustaining human society. Not all research returns a benefit. For that which does, the time span from discovery and publication to practical benefit is not immedi- ate and the level of societal benefit varies widely. This nation has benefited substantially from its investments in re- search at the state agricultural experiment stations, as has been shown in many studies, of which that of Evenson et al.t 1979, is the most PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 55 recent (10). So far we have not faced the issue or attempted to quantify in any way the quality of agricultural research. Because of the mandate for the research, the quality of its performance must relate in some tan- gible way to societal benefits. A human activity set in an environment (the land-grant universities) in which the rewards relate only incidentally to societal benefits arising from agriculture and more directly to the approval of colleagues in other fields bent on excellence in the basic sciences and the performing arts creates career hazards contributing to the isolation in academe of which agricultural faculties are accused. No one considering the issue has yet seemed to acknowledge that the expectations of the clientele (agriculture) and the expectations of the employer (the university) drum in different cadence even if both are presumed to be pointed in the same direction, human progress. Agricultural scientists are faced with the ever-widening public aware- ness of the margin of hunger constantly tearing at the edges of the ex- panding world population and on occasion making great inroads by death from starvation and debilitation. They have been aware of this all of their careers (8). They have been waging a war against world starvation without much help ( 18) . The problem for those who make decisions about public investment in agricultural research (or any research for that matter) is that the decision for today's need had to be made yesterday; while that for tomorrow's emergency has to be made today. The studies reported here show that one objective way of estimating past performance and poten- tial benefits from agricultural research is to measure the output of scientific publications over time. The technique is neither fool-proof nor time-tested. One cannot now predict with certainty individual and insti- tutional response if public bodies were to institute such a device as an early monitor of returns from public investment in research. One sus- pects there might then be some effort by institutions to inflate evidence of research output. This would confuse the issue only to a limited degree, however, especially if all concerned participated in the finagle to the same relative degree. In the study of relationships of the immediate past at the Illinois station, in which no conscious effort could have been made to manipulate evidence, no real and important changes over time could be observed in the relationship of station-reported to peer-edited journal publications among departments. Nor were there discerned any meaningful changes over time in the relationship of either of these to senior staff members, to investments of either actual or constant-value dollars, or to them combined. With the existing intrauniversity pressure for acceptance only of publications in prestigious peer-edited journals as evidence of schol- 56 — BULLETIN NO. 762 arly and scientific attainment for promotion, it is surprising that such changes were not seen. To be sure, there were marked and continuing differences among the departments in the proportion of their total sta- tion-reported publications that appeared as peer-edited publications. This relationship was consistent over time and appeared to be more a reflection of the traditions of the field than of the internal university policy of conformity. Public Examination — Invasion of Privacy? In the late 1960's survey of 104 specialists comparing their opinion of relative rank order and actual paper count in four peer-edited jour- nals for the animal agriculture research units in the 48 contiguous-state stations, comments unsolicited and unidentifiable as to source were received by the author indicating that some scientists believed any examination of research competence was uncalled for and unnecessary; some implied it was an invasion of the area of academic freedom. More recently equally vigorous opposition has been expressed. At the time of initiation of the first objective survey of research competence in the early 1960's, the writer was greatly influenced by those views and as a result did not publish his findings. He initiated the studies as a private endeavor solely to answer objectively questions put by the highest circles of U.S. executive government and to which he was ashamed to answer as a matter of personal opinion. The death of President J. F. Kennedy brought to a close the detailed examination of agricultural research by the President's Science Advisory Committee, which had it been com- pleted and a comprehensive report published then would have, if it de- veloped as projected, contributed much to public understanding of the organizational structure, the competence, and the purpose of this na- tion's agricultural research establishment. In the meantime comments have appeared in the science literature pro and con (6, 16, 28) about the basic competence of agricultural researchers and sometimes about the basic integrity of the organiza- tional structure of which they are a part. Presumably as a result of these reactions, Congress stipulated in the appropriations enactments of the Food and Agriculture Act of 1977 even closer future surveillance by federal agencies of agricultural research, and centralized even further the decision-making process about the subjects of agricultural research and the scientific technology to be employed in their resolution. None of that influence is yet injected into the published record. PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 57 The Problem for the Public The problem before us now is whether the directions taken for us by our federal Congress and our federal action agencies are the proper ones for optimum future service of agricultural research to the Ameri- can public. The penalty of failure will be great and undeniably subject to wider recognition than will be the rewards of success. Unfortunately, government does not enjoy detached, disinterested examination of its own actions and has not authorized and is not likely to authorize lively research into the most effective and proper way for the public in its own interests to support agricultural research. This examination of the output of technical journal articles and peer-edited scientific papers by the state agricultural experiment sta- tions system of the United States, with special emphasis on one station, Illinois, for items of detail the national data do not provide, has sum- marized the situation for a unique period in U.S. history. Since World War II science and its application to public concerns have expanded at heretofore unprecedented rates. There are now signs of an imminent decrease in those rates, which in the face of the world's projected popu- lation expansion raises important questions of national policy for agri- cultural research. The data presented here close out a period of federal funding and reporting policy. The stage is set for future comparative studies of the effectiveness of new policies initiated at the end of the period covered in which the public and federal and state governments have a great stake. 58 — BULLETIN NO. 762 References Cited 1. Anonymous. Annual report on the state agricultural experiment stations. Office of Experiment Stations, U.S. Department of Agri- culture. 1901-1959. 2. Anonymous. Funds for research at state agricultural experiment stations and other cooperating institutions. Cooperative State Research Service, U.S. Department of Agriculture, 1960-1975. (Last report appeared in January, 1976, as CSRS 15-11.) 3. Arndt, T. M., D. G. Dalyrymple, and V. W. Ruttan, editors. Resource allocation and productivity in national and international agricul- tural research. University of Minnesota Press, Minneapolis. 617p. 1977. 4. Bredahl, M., and W. Peterson. The productivity and allocation of research: U.S. agricultural experiment stations. American Journal of Agricultural Economics 58:684-692. 1976. 5. Carlson, C. W., D. J. Bray, and G. J. Mountney. Scientist/year and publication expenditures for U.S. poultry research in 1974 and 1975. Poultry Science 56:1960-1967. 1977. 6. Committee on Research Advisory to the U.S. Department of Agri- culture. Report. Division of Biology and Agriculture, National Research Council/National Academy of Sciences. National Tech- nical Information Service, Springfield, Va. 464p. 1972. (Often called the Pound Report after the chairman of the committee, Glenn S. Pound.) 7. Darlington, C. D. The dead hand on discovery. Discovery 9:358-362 and 10:7-11. 1949-50. 8. De Kruif, Paul. Hunger fighters. Harcourt, Brace, New York. 377p. 1928. 9. Evenson, R. E., and Y. Kislev. Agricultural research and productivity. Yale University Press, New Haven and London. 204p. 1975. 10. Evenson, R. E., P. E. Waggoner, and V. W. Ruttan. Economic bene- fits from research: an example from agriculture. Science 205:1101- 1107. 1979. 11. Greenbaum, Leonard. A special interest. The Atomic Energy Com- mission, Argonne National Laboratory, and the Midwestern Uni- versities. University of Michigan Press, Ann Arbor. 222p. 1971. 12. Kevles, D. J. The health of science: Has American science lost its vigor? Harper's, August: 26, 28-30. 1979. 13. Knoblauch, H. C., E. M. Law, and W. P. Meyer. State agricultural experiment stations: a history of research policy and procedures. U.S. Department of Agriculture Miscellaneous Publication 904. 262p. 1962. 14. Mayer, A., and J. Mayer. Agriculture, the island empire. Daedalus (Journal of American Academy of Arts and Sciences) Summer: 83-95. 1974. 15. Milton, H. S. Cost-of-research index, 1920-1970. Operations Research 20:1-18. 1972. PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 59 16. Nuckton, C. F. The investment in agricultural research: a success story. Division of Agricultural Sciences, University of California. California Agriculture, September: 7-9. 1979. 17. Peterson, W. L. The allocation of research, teaching and extension personnel in U.S. colleges of agriculture. American Journal of Agricultural Economics 51:41-56. 1969. 18. Read, Hadley. Partners with India: building agricultural universities. University of Illinois at Urbana-Champaign, College of Agricul- ture. 159p. 1974. 19. Rescher, N. Scientific progress: a philosophical essay on the econom- ics of research in natural science. University of Pittsburgh Press. 278p. 1978. 20. Salisbury, G. W. Reference journals used by dairy scientists. Journal of Dairy Science 35:566-569. 1952. 21. Salisbury, G. W. Contributions of reproductive physiologists, geneti- cists, nutritionists, health scientists and extension specialists in improving dairy cattle productivity. Pages 117-127 in A Symposium on Animal Agriculture. Edited by J. R. Lodge. University of Illi- nois at Urbana-Champaign, College of Agriculture, Agricultural Experiment Station Special Publication 57. 1979. 22. Salisbury, G. W., K. E. Harshbarger, J. R. Lodge, L. R. Fryman, and R. E. Marcoot. Returns from public investment in research on milk production. University of Illinois at Urbana-Champaign, Department of Agricultural Economics Dairy Marketing Facts AE-4314. 3p. 1973. 23. Salisbury, G. W., and R. G. Hart. The evolution and future of Amer- ican animal agriculture. Perspectives in Biology and Medicine 22: 394-409. 1979. 24. Schultz, T. W. The allocation of resources to research. Pages 90- 120 in Resource Allocation in Agricultural Research. Edited by W. L. Fishel. University of Minnesota Press, Minneapolis. 1971. 25. Scully, M. G. The well-known universities lead in rating of faculties' reputation. Chronicle of Higher Education, January 15, 1979. (Re- port of a 1977 survey by E. C. Ladd, Jr., and S. M. Lipset, Social Science Data Center, University of Connecticut, Storrs.) 26. Sonka, S. T., and D. I. Padberg. Estimation of an academic research and development price index. University of Illinois at Urbana- Champaign, Department of Agricultural Economics, No. 79 E- 100. 1979. 27. Swanson, E. R. The role of technology in Illinois crop production. Pages 51-66 in Papers by the Recipients of Awards in 1977, Paul A. Funk Recognition Program. University of Illinois at Urbana- Champaign, College of Agriculture Special Publication 48. 1977. 28. Wade, N. Agriculture: NAS panel charges inept management, poor research. Science 179:47. 1973. 29. Williams, S. W., S. Strong, and C. B. Baker. Benefits stem from re- search on corn production. Illinois Research 15(3) :3-4. 1973. 60 — BULLETIN NO. 762 Appendix: Raw Data for Study lie The following table summarizes the raw data obtained for the study of full-length peer-edited articles published in 66 selected journals for the calendar years 1967, 1968, and 1969. The subject matters relate basically to departments or units in the Illinois Agricultural Experiment Station except that animal sciences combines the output of two Illinois departments and the animal production publications of the Veterinary Research unit of the University of Illinois College of Veterinary Medi- cine. No journals dealing with animal pathologies and their control were included in the journals selected for review. Subject matters not in- cluded in the responsibilities of the Illinois departments or units are listed under "other." The journals reviewed (shown after the table) were developed from a list provided in 1970 by heads of departments and prominent scien- tists at the Illinois station. Estimates from fiscal year data indicated that approximately 37 percent of the national total of technical journal articles published by the state agricultural experiment stations for the period appeared in these journals. For Illinois the estimate was 36.5 percent. Articles with multiple authors were credited proportionately to their employers without regard to author order; this procedure accounts for the fractional numbers in the table. Blanks appear in the table where either no publications were recorded for that subject matter or the sub- ject matter was not clearly identified for the station, in which case the publication or proportionate share thereof was credited to "other." For normalizing the distribution of these observations and for statistical analysis, 0.5 was added to each observation and the square root trans- formation of that figure used. The data are recorded here by states and by subject matters before that transformation was made. As described in the text, they represent an adequate sample for delineation of subject matter scientific publica- tion output by the Illinois station. Whether they do so for any other state's output for a designated subject matter we were unable to test. A rank array of the states based on the total number of publications credited to the agricultural experiment stations of the 50 states results in an order varying slightly from a rank order based on least square means of annual publications per subject matter unit given for the first 10 sta- tions in Table 6. Based on the raw data totals for each station for the three years, the rank order for the top ten stations is California, Wis- consin, New York, Illinois, Michigan, Indiana, North Carolina, Iowa, Minnesota, and Oregon. 11 V SCO 00 P4 too —NO NO NO ««• — -«r NO tx PI o tx — — — •»_— — 10 PI OOOOcoto — NoOtoto to OP) co — ON — om-a- NOO M*OOtoOtxOtxOO NOtOtoOONOONQOtxQNtN NO O 00 to 10 tx to «0 — co^NOPitoooA'-'ONOO coO — O — — txlxtxto o oi NO oc i-f o co o' •«»•' NO' to' PJ P)P1 tx O\ to" tnOOOOP)— ONOOOO^- •s o ? J3 — NO — CO to CO tO NOtotxtxo — ONO OO — P1ONOOOVO COP1ONO — OOO — — 00 •-* PJIOPJ •— CN) tOOOIOOtxOtO IxlO otoooioNoooo NOCO totx fopjto— — — CO— P)«0 O to PI ON •0 li r o K If — — PI — Pito — NOIO OOOtoOtoOPJNON to * — NOIOO — totxo — to— — P> O OOtOPJO OO o to — o — txoq o Oto — OOOP) O O OP) — PJOO o - P) 0 PJ PIP) to'tooo'NO — t — ^f^fd — Tf to — •* P) •» p) OOXSOO— OO — ONO OOVONOOPI— — — co^to P) to pi to V NO co NO V •* to ^f — ON"*- •» — ^P) P4 COCNJOOCOPIO— OOtx NOOONO — ^-tooooMoto if to— O ss§s§?8?°.;§ PJ O^OPJNO — — to ONO — IXTj-OOtONO^ON to o' ON NO o' pi 06 o\ to NO' <* tx' 06 NO •»' pi oo o to pi ix' •*' PJ to pi to o\ o< o' o\ I8 g c i o c*j ob *— ii— < o NO o\ oo ^OVOONO^NNONOO NO NO IX. ^ 0^.0 CO P). CO loom — Pi — to^OMO ^.^ "».«. 9^.^^^.^ i P) S.T. ? OMPJONO to- lOO>tOOOlO OOO COOCO Q OOto oq in to O — IO PJPJ »-> to to co NO — too — p» OOCOO — OcoOOO oooom ootoiotoo co P1CNJ PI M — — P) CO ''*''.''. ' ' a a : : : : :.a : : 1 (fl : * fj 3 fj-sl.sfisl if lilj-i in €fi4l'i9f lf@ g C X m Jj u n v.% s^/j 62 — BULLETIN NO. 762 Peer-Edited Journals Used in Study He Agricultural Engineering Agronomy Journal American Economic Review American Journal of Agricultural Economics (formerly Journal of Farm Economics) American Journal of Sociology American Society for Horticultural Science Journal (formerly American Society for Horticultural Science Proceedings) American Society of Agricultural Engineers — Transactions American Society of Civil Engineers — Geotechnical Engineering Divi- sion Proceedings American Society of Civil Engineers — Hydraulics Division Proceedings American Society of Civil Engineers — Irrigation and Drainage Divi- sion Proceedings American Sociological Review American Wood Preservers' Association Proceedings Applied Microbiology Canadian Entomologist Canadian Journal of Agricultural Economics Cereal Chemistry Crop Science Econometrica Entomological Review (English translation, from U.S.S.R.) Federation Proceedings, Federation of American Societies for Experi- mental Biology Forest Products Journal Forest Science Genetics Horticultural Research HortScience Journal of Agricultural and Food Chemistry Journal of Agricultural Engineering Research Journal of American Dietetic Association Journal of Animal Science Journal of Bacteriology Journal of Consumer Affairs Journal of Dairy Science Journal of Economic Entomology Journal of Food Science Journal of Food Technology Journal of Forestry Journal of General Microbiology Journal of Heredity Journal of Home Economics Journal of Hydrology Journal of Insect Physiology Journal of Invertebrate Pathology PRODUCTIVITY OF STATE EXPERIMENT STATIONS — 63 Journal of Milk and Food Technology Journal of Nutrition Journal of Reproduction and Fertility Journal of Soil and Water Conservation Land Economics Lipids Mycologia Nematologica Phytochemistry Phytopathology Plant and Soil Plant Disease Reporter Plant Physiology Poultry Science Regional Science Association Rural Sociology Silvae Genetica Sociological Quarterly Soil Science Soil Science Society of America Journal Textile Research Journal Virology Weed Science Wood Science and Technology 3M— 7-80— 47931— aj UNIVERSITY OF ILLINOIS-URBANA Q 630.7IL6B C008 BULLETIN URBANA 762 1980 30112019531141