2 Replies Latest reply on Sep 1, 2017 3:16 PM by as35374

    Classloader Issue on Q4 2016 CU3

    rs0048203

      Q42016 CU3 Custom B2 works on Development Environment does not work on Integration Environment(after recent promotion).

      On Integration Enviroment where Custom B2 does not work, get 'ClassNotFoundException Could not load class from any of the allowed classloaders' in tomcat stdout log.

      Based on the error messages below, the loadClass method of the ExtendedLibraryClassLoaderManager can not load a class from a third party API.

      Has anyone seen an issue with the Class Loader loading third party libraries in custom B2s on Q4 2016 CU3?

       

       

      'ClassNotFoundException':

      INFO   | jvm 1    | 2017/05/04 09:00:26 | May 04, 2017 9:00:26 AM org.apache.catalina.core.StandardWrapperValve invoke

      INFO   | jvm 1    | 2017/05/04 09:00:26 | SEVERE: Servlet.service() for servlet [nmelSupportTool] in context with path [/webapps/unm-createaticket-BBLEARN] threw exception [Handler processing failed; nested exception is java.lang.NoClassDefFoundError: com/rightnow/ws/wsdl/RequestErrorFaultDetail] with root cause

      INFO   | jvm 1    | 2017/05/04 09:00:26 | java.lang.ClassNotFoundException: Could not load class com.rightnow.ws.wsdl.RequestErrorFaultDetail from any of the allowed classloaders: [{urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-data-integration/libextcache/data-integration-api-3100.0.3-rel.19+7e885f5.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-goal/libextcache/goal-api-3100.0.3-rel.19+7e70f78.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-assignment/libextcache/assignment-api-3100.0.3-rel.20+d20971b.jar, /nfs/ilearn/content/vi/BBLEARN/plugins/bb-assignment/libextcache/crocodoc-registration-api-3100.0.3-rel.16+337833b.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-portfolio/libextcache/portfolio-api-3100.0.3-rel.19+7b846e0.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-common-styles/libextcache/common-styles-api-3100.0.3-rel.21+25a868c.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-social-learning/libextcache/bb-social-learning-api-3100.0.3-rel.16+7ee9bc8.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-submission-services/libextcache/submission-services-api-3100.0.3-rel.19+7255403.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/Bb-wiki/libextcache/wiki-api-3100.0.3-rel.24+d8f3589.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/Bb-bbcms/libextcache/bbcms-api-3100.0.3-rel.20+03e4198.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/Bb-discussionboard/libextcache/discussionboard-api-3100.0.3-rel.16+d08d8ef.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-collaborate/libextcache/collab-api-3100.0.3-rel.26+ac8f5df.jar, /nfs/ilearn/content/vi/BBLEARN/plugins/bb-collaborate/libextcache/ical4j-1.0.3.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-retention/libextcache/retention-api-3100.0.3-rel.16+726333a.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-inline-grading/libextcache/inline-grading-api-3100.0.3-rel.19+e318645.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-assessment/libextcache/assessment-api-3100.0.3-rel.19+70840a7.jar]}, {urlPaths=[/opt/blackboard/webapps/content/WEB-INF/libext/bb-content-api-3100.0.3-rel.19+c20668a.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-task-progress/libextcache/task-progress-api-3100.0.3-rel.21+e3e73ab.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-rest/libextcache/rest-api-3100.0.3-rel.16+c73784a.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-vtbe-tinymce/libextcache/vtbe-tinymce-api-3100.0.3-rel.16+be82c68.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-xss-input-validation/libextcache/xss-input-validation-api-3100.0.3-rel.16+fa9bfff.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-rubric/libextcache/rubric-api-3100.0.3-rel.16+ef7906d.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-date-management/libextcache/date-management-api-3100.0.3-rel.16+54de61d.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-grading/libextcache/grading-api-3100.0.3-rel.18+c89d74c.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-content-model/libextcache/content-model-api-3100.0.3-rel.18+c57cf8e.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-software-updates/libextcache/software-updates-api-3100.0.3-rel.19+427763a.jar, /nfs/ilearn/content/vi/BBLEARN/plugins/bb-software-updates/libextcache/cloud-services-base-rest-api-3.9.5.15121.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-telemetry/libextcache/telemetry-api-3100.0.3-rel.16+879e202.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-stream/libextcache/bb-stream-api-3100.0.3-rel.21+05f5b78.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-cloud-profiles/libextcache/cloud-profiles-api-3100.0.3-rel.17+96bba37.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/Bb-caliper/libextcache/caliperb2-api-3100.0.3-rel.19+9198677.jar]}]

      INFO   | jvm 1    | 2017/05/04 09:00:26 |       at blackboard.platform.servlet.ExtendedLibraryClassLoaderManager$LibClassLoaderOperation.loadClass(ExtendedLibraryClassLoaderManager.java:697)

      INFO   | jvm 1    | 2017/05/04 09:00:26 |       at blackboard.platform.servlet.ExtendedLibraryClassLoaderManager$LibClassLoaderOperation.loadClass(ExtendedLibraryClassLoaderManager.java:682)

      INFO   | jvm 1    | 2017/05/04 09:00:26 |       at blackboard.platform.servlet.ExtendedLibraryClassLoaderManager.loadExtendedClass(ExtendedLibraryClassLoaderManager.java:440)

      INFO   | jvm 1    | 2017/05/04 09:00:26 |       at blackboard.tomcat.servletcontainer.OverridableClassLoader.loadClass(OverridableClassLoader.java:199)

      INFO   | jvm 1    | 2017/05/04 09:00:26 |       at blackboard.tomcat.servletcontainer.PlugInOverrideClassLoader.loadClass(PlugInOverrideClassLoader.java:76)

      INFO   | jvm 1    | 2017/05/04 09:00:26 |       at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1118)

       

       

       

       

      Another thing we have noticed is that on both Environments seeing 'there was insufficient free space available after evicting expired cache entries'. (Known Issue).

       

      'there was insufficient free space available after evicting expired cache entries':

      INFO   | jvm 1    | 2017/05/04 08:05:23 | May 04, 2017 8:05:23 AM org.apache.catalina.webresources.Cache getResource

      INFO   | jvm 1    | 2017/05/04 08:05:23 | WARNING: Unable to add the resource at [/WEB-INF/classes/edu/unm/nmel] to the cache because there was insufficient free space available after evicting expired cache entries - consider increasing the maximum size of the cache

       

      We are wondering if greater resource needs on Integration Environment are causing this failure on Integration and not on Development?

       

      Any advice?

        • Re: Classloader Issue on Q4 2016 CU3
          rs0048203

          Research Update:

          'there was insufficient free space available after evicting expired cache entries'. (Known Issue) - is not related to this issue.

          Modified Custom B2 code to view classpath well before Classloader error to confirm that it does have the correct third party JAR file before the ClassNotFoundException displayed error message on screen.

          But,  the only plugin JARs listed on screen and in the tomcat stdout log warning are Blackboards (repeated below):

          Any advice?

          INFO   | jvm 1    | 2017/05/11 08:24:10 | java.lang.ClassNotFoundException: Could not load class com.rightnow.ws.wsdl.RequestErrorFaultDetail from any of the allowed classloaders: [{urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-data-integration/libextcache/data-integration-api-3100.0.3-rel.19+7e885f5.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-goal/libextcache/goal-api-3100.0.3-rel.19+7e70f78.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-assignment/libextcache/assignment-api-3100.0.3-rel.20+d20971b.jar, /nfs/ilearn/content/vi/BBLEARN/plugins/bb-assignment/libextcache/crocodoc-registration-api-3100.0.3-rel.16+337833b.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-portfolio/libextcache/portfolio-api-3100.0.3-rel.19+7b846e0.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-common-styles/libextcache/common-styles-api-3100.0.3-rel.21+25a868c.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-social-learning/libextcache/bb-social-learning-api-3100.0.3-rel.16+7ee9bc8.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-submission-services/libextcache/submission-services-api-3100.0.3-rel.19+7255403.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/Bb-wiki/libextcache/wiki-api-3100.0.3-rel.24+d8f3589.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/Bb-bbcms/libextcache/bbcms-api-3100.0.3-rel.20+03e4198.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/Bb-discussionboard/libextcache/discussionboard-api-3100.0.3-rel.16+d08d8ef.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-collaborate/libextcache/collab-api-3100.0.3-rel.26+ac8f5df.jar, /nfs/ilearn/content/vi/BBLEARN/plugins/bb-collaborate/libextcache/ical4j-1.0.3.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-retention/libextcache/retention-api-3100.0.3-rel.16+726333a.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-inline-grading/libextcache/inline-grading-api-3100.0.3-rel.19+e318645.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-assessment/libextcache/assessment-api-3100.0.3-rel.19+70840a7.jar]}, {urlPaths=[/opt/blackboard/webapps/content/WEB-INF/libext/bb-content-api-3100.0.3-rel.19+c20668a.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-task-progress/libextcache/task-progress-api-3100.0.3-rel.21+e3e73ab.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-rest/libextcache/rest-api-3100.0.3-rel.16+c73784a.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-vtbe-tinymce/libextcache/vtbe-tinymce-api-3100.0.3-rel.16+be82c68.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-xss-input-validation/libextcache/xss-input-validation-api-3100.0.3-rel.16+fa9bfff.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-rubric/libextcache/rubric-api-3100.0.3-rel.16+ef7906d.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-date-management/libextcache/date-management-api-3100.0.3-rel.16+54de61d.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-grading/libextcache/grading-api-3100.0.3-rel.18+c89d74c.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-content-model/libextcache/content-model-api-3100.0.3-rel.18+c57cf8e.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-software-updates/libextcache/software-updates-api-3100.0.3-rel.19+427763a.jar, /nfs/ilearn/content/vi/BBLEARN/plugins/bb-software-updates/libextcache/cloud-services-base-rest-api-3.9.5.15121.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-telemetry/libextcache/telemetry-api-3100.0.3-rel.16+879e202.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-stream/libextcache/bb-stream-api-3100.0.3-rel.21+05f5b78.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/bb-cloud-profiles/libextcache/cloud-profiles-api-3100.0.3-rel.17+96bba37.jar]}, {urlPaths=[/nfs/ilearn/content/vi/BBLEARN/plugins/Bb-caliper/libextcache/caliperb2-api-3100.0.3-rel.19+9198677.jar]}]

            • Re: Classloader Issue on Q4 2016 CU3
              as35374

              Hello guys!

              I have a similar problem:

               

              Handler processing failed; nested exception is java.lang.NoClassDefFoundError: blackboard/apis/assessment/QuestionWrapper Could not load class blackboard.apis.assessment.QuestionWrapper from any of the allowed classloaders: [{urlPaths=[/usr/local/blackboard/content/WEB-INF/libext/bb-content-api.jar]}]

               

              does anyone have any tips?

               

              Thanks!