1179679 917532 3113240 3113242 6258944 9798548 22 698 917532 5 1212447 9900271 9900272 9900273 9900274 27 2007-06-07 15:42:27.210 2009-05-15 13:15:52.557 1179681 1179683 1179684 1179685 1179686 1179687 1179715 1179716 1179717 1179764 1179765 1179798 1179799 2162968 3113179 3113180 3113243 3113248 3113251 3113252 3113253 3637757 6258845 6258950 6258953 9798550 8913345 1023 22 769 1023 5 8946091 7 2009-02-09 09:48:38.713 2009-02-10 11:17:53.520 8913346 8913347 8913348 8913349 8913352 8913361 9076792 9076794 9076796 9076798 9076801 9076803 9076804 9076802 9076799 9076797 9076795 9076793 770 769 780 789 22 769 5 767 3258 3259 11 2007-02-05 14:31:26.453 2007-02-05 16:00:04.157 771 772 773 774 775 776 777 778 779 788 769 22 770 1023 163852 589949 22 5 766 656440 656441 656442 656443 1343569 3 2007-02-05 14:31:16.673 2007-04-18 05:10:14.620 163851 589961 589930 589928 22 589928 5 622695 656326 656327 656328 656329 656330 3 2007-04-11 09:59:56.567 2007-04-11 13:04:41.093 589931 589936 3113134 917532 22 698 917532 5 3178654 3707562 3707563 3707564 16 2008-01-15 11:41:47.420 2008-04-28 12:42:06.647 3113138 3113140 3113142 3113144 3113146 3113218 3113220 3113221 3113325 3637739 3637741 3637743 3637756 3637760 3637762 3309583 3309584 589928 22 589930 589939 917527 917543 917583 2163047 2163060 3113106 3113110 3113176 22 5 622694 3342816 3342817 3342818 3342819 3342820 3342821 3342822 3342823 3342824 3342825 3342826 16 2007-04-11 09:50:01.490 2008-01-16 11:15:52.113 589938 917526 917542 917553 917554 917555 917581 1179749 2163046 2163064 3113105 3113107 3113111 3113166 3113170 6259292 3113115 22 2163016 3113115 5 6226500 6326081 2 2008-10-06 11:09:17.437 2008-10-06 11:16:43.510 6259294 6291588 3637952 3113115 22 2163016 3113115 5 3670702 8454298 3 2008-05-08 11:33:35.547 2009-01-05 15:20:36.990 3637987 8355869 3735604 3735605 3637958 3113115 22 2163016 3113115 5 3670706 12288007 12288008 22 2008-05-08 11:37:22.423 2010-05-10 16:28:11.627 3637979 3637981 3637993 3637997 3637998 3637999 3638002 6258841 6258861 6258939 6258940 8061027 8061028 8061030 8061031 8061071 8061074 8355881 12222470 12222471 12222474 3735603 3637956 3113115 22 2163016 3113115 5 3670705 4 2008-05-08 11:36:29.567 2009-01-05 15:23:01.047 3637991 3638024 8355870 3735606 3637963 3113115 22 2163016 3113115 5 3670710 13 2008-05-08 11:40:40.903 2008-10-09 14:22:24.440 3637967 3637974 3637978 3637982 3637984 3638062 3638064 6258816 6258836 6258854 6258855 6259332 3113176 589928 22 589928 5 3178695 3342836 3342837 3342838 6 2008-01-16 11:28:39.897 2008-01-16 13:50:41.633 3113182 3113184 3113185 3113187 3113188 780 770 22 769 770 5 777 983042 29 2007-02-05 15:44:32.787 2007-04-30 15:50:36.463 781 782 783 784 785 786 787 792 793 794 795 796 797 798 799 800 802 804 805 806 807 808 809 163849 589950 589951 917505 917506 30 1023 769 8913345 22 769 5 1020 10455500 10455501 10455502 10455503 10455504 10455505 10455506 10455507 10455508 10455509 10455510 10455511 10455512 10455513 10455514 10455515 10455516 10455517 10455518 10455519 10455520 753671 17 2007-03-01 08:35:46.057 2009-06-04 12:42:53.023 1024 1025 1027 1028 1033 1034 1038 1039 1073 1074 1080 163853 589962 2163014 8913342 10354897 6258828 22 22 5 6226052 7045143 7045144 7045145 7045146 7045147 12 2008-08-20 12:41:51.660 2008-10-23 10:22:07.057 6258830 6258832 6258835 6258853 6258888 6258892 6258893 6259212 6259213 6259295 6946819 5 21 22 133 134 135 136 137 138 139 140 141 142 143 144 145 146 4882459 19300575 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 global 163852 769 22 769 5 294923 11864093 11864094 11864095 11864096 11864097 11864098 11864099 11864100 11864101 11864102 11864103 11864104 11864105 11864106 11864107 1015809 1343571 34 2007-03-12 11:17:25.610 2010-05-06 15:48:18.237 589945 589946 589947 589948 589964 589965 917509 917510 917511 917515 917516 917517 917518 917556 917557 917558 917559 917561 917563 1179705 1179712 1179713 1179714 1179839 1179840 1179848 1179849 1179850 6258820 6258821 8912910 8913001 11797302 557069 557074 557075 1048585 1540123 789 770 22 769 770 5 786 7 2007-02-05 16:00:22.540 2007-11-27 14:41:04.717 790 791 803 917586 917587 2162953 31 8356190 2163016 22 2163016 5 8388941 8455431 8455432 1 2009-01-14 14:53:22.057 2009-01-14 14:53:22.057 1179745 917543 22 589928 917543 5 1212512 1245544 1245545 1245546 1245547 1245548 1245549 4 2007-06-22 15:11:59.833 2007-06-22 15:36:39.367 1179746 1179747 1179748 3113097 2163017 22 2163016 2163017 5 3178621 14 2008-01-11 16:50:35.080 2008-12-22 11:03:57.903 3113099 3113102 3113160 3113161 3113173 3113174 3113175 3113181 6258942 8061020 8061021 8061022 8061073 3309586 8913021 3113115 22 2163016 3113115 5 8945784 9437185 9437186 20 2009-01-23 10:33:06.733 2009-02-17 11:11:54.183 8913023 8913026 8913031 8913033 8913035 8913037 8913039 8913040 8913042 8913044 8913045 8913047 8913049 8913050 8913052 8913054 8913056 8913194 9371650 9076737 9076738 9076739 9076740 9076741 9076742 9076743 9076744 9076745 9076746 9076747 9076748 9076749 2163060 589928 22 589928 5 2195824 2230486 2230487 2230488 2230489 5 2007-12-07 15:37:50.557 2007-12-07 15:58:09.530 2163061 2163062 2163063 2163065 581 22 22 5 579 3029 225 753673 13 2007-01-10 13:50:38.427 2007-01-23 11:31:36.410 582 649 650 651 652 654 655 656 664 665 682 686 23 3113551 22 22 5 3179050 12 2008-02-13 10:24:08.407 2009-01-05 15:17:11.513 3113553 3113555 3113559 3113713 3113715 3113716 3113718 3113720 3113721 8355866 8355867 3309622 3309631 3113110 589928 22 589928 5 3178633 3342812 3342813 3342814 3342815 4 2008-01-14 09:38:57.487 2008-01-16 11:14:33.610 3113163 3113165 3113167 599 22 22 5 597 4 2007-01-18 15:38:10.963 2007-01-18 15:43:25.300 600 601 602 15 16 17 3113106 589928 22 589928 5 3178630 3342686 3342687 3342688 3342689 1 2008-01-14 09:13:18.700 2008-01-14 09:13:18.700 604 22 22 657 5 602 1246285 1246286 1246287 1246288 1246289 1246290 1246291 1246292 1246293 1246294 1246295 1246296 1246297 1246298 1246299 1246300 1246301 1246302 1246303 1246304 1246305 1246306 241 254 255 256 30 2007-01-18 15:59:19.917 2007-07-16 16:17:51.217 606 607 608 609 703 725 726 727 728 731 732 733 734 735 736 737 738 739 744 915 916 917 918 991 992 589932 589952 589963 1179851 29 3113115 2163016 3637952 3637956 3637958 3637963 3638049 6259292 8913021 22 2163016 5 3178637 16876498 16876499 16876500 16876501 16876502 16876503 16876504 16876505 138 2008-01-14 13:21:45.133 2011-05-11 14:57:22.003 3113116 3113118 3113119 3113132 3113190 3113191 3113193 3113195 3113197 3113199 3113201 3113209 3113211 3113213 3113224 3113226 3113232 3113234 3113236 3113238 3113256 3113264 3113266 3113339 3113341 3113342 3113347 3113349 3113351 3113352 3113364 3113370 3113372 3113373 3113375 3113376 3113378 3113380 3113382 3113384 3113386 3113388 3113390 3113392 3113394 3113396 3113398 3113418 3113420 3113421 3113422 3113506 3113569 3113571 3113573 3113575 3113576 3113578 3113579 3113581 3113583 3113585 3113587 3113590 3113592 3113593 3113595 3113597 3113599 3113601 3113603 3113605 3113607 3113726 3637668 3637670 3637672 3637674 3637765 3637767 3637769 3637771 3637773 3637774 3637776 3637778 3637780 3637781 3637786 3637790 3637791 3637793 3637795 3637796 3637797 3637799 3637801 3637803 3637805 3637807 3637809 3637811 3637826 3637872 3637875 3637877 3637879 3637880 3637881 3637882 3637896 3637950 3637969 3637972 3638059 3638060 3638067 3638071 3638072 6258814 6258817 6258824 6258825 6258833 6258851 6258857 6258862 6258864 6258866 6258868 6258870 6258872 6259296 8913057 11240268 11240270 16777382 3309612 3309614 3309615 3309616 3735589 3735590 2163017 2163016 3113097 3637864 22 2163016 5 2195781 9438602 9438603 9438604 9438605 9438606 9438607 9438608 27 2007-12-05 08:57:43.203 2009-03-03 13:35:27.663 2163018 2163019 2163028 2163029 2163030 2163031 2163032 2163033 2163034 2163035 2163036 2163037 3113095 3113101 3113736 3637862 6258941 8060966 8060968 8061033 8355901 8355904 8355905 8913074 9372010 9372011 2326549 2326552 8159309 2163016 22 2163017 3113115 8356190 22 5 2195780 8455428 8455429 8455430 4 2007-12-05 08:55:31.777 2009-01-14 14:50:16.590 3113113 3113131 8356188 131077 4]]> 6258944 1179679 22 698 917532 1179679 5 6226165 24118125 24118126 24118127 12 2008-08-21 18:01:47.250 2013-12-09 12:22:02.317 6258945 6258946 6258948 12484630 12484631 12484632 12484634 12484636 13140047 13140049 24051900 6291503 12779522 12779523 12779524 9798548 1179679 22 698 917532 1179679 21364757 5 9831292 19166908 19166909 19166910 24 2009-05-15 13:14:57.057 2012-11-07 15:24:08.197 9798551 9798556 9798558 9798560 9798562 9798565 9798568 9798573 9798574 9798577 9798656 9798658 11796495 11796497 11796498 13926700 13926701 13926717 13926724 13926730 13926732 19039294 19041131 2163047 589928 22 589928 5 2195811 2230309 2230310 1 2007-12-06 15:16:31.857 2007-12-06 15:16:31.857 659 22 22 5 656 6 2007-01-19 16:04:18.030 2008-04-28 12:28:58.433 660 661 662 663 3637744 22 3309579 3309580 937 22 938 946 22 5 934 4824 4825 753665 753666 2 2007-02-21 14:32:11.103 2007-02-21 14:44:29.377 945 938 937 22 937 5 935 5506256 5506257 5506258 5506259 5506260 5506261 5506262 5506263 5506264 5506265 5506266 5506267 5506268 5506269 5506270 5506271 5506272 5506273 5506274 5506275 5506276 5506277 360449 65 2007-02-21 14:32:30.070 2008-06-23 10:54:55.977 939 940 941 943 944 1081 1082 1083 1084 1085 1087 1088 1089 1090 1095 1096 1099 163842 163843 163844 163845 163846 163848 163855 163856 163869 589908 589910 589911 589912 589944 589953 589966 917507 917508 917519 917520 917521 917522 917523 917524 917525 917541 917566 1179852 1179853 1179854 1179855 1179856 1179857 1179858 1179859 1179860 1179861 1179862 1179863 1179864 1179865 2163057 5374391 5374392 5374398 5374403 5374405 229379 229380 229381 229383 229382 1540124 1540125 1540126 32 33 917583 589928 22 589928 5 950349 983647 983648 983649 983650 983651 983652 983653 983654 983655 983656 983657 983658 983659 983660 2 2007-05-23 14:01:46.997 2007-05-24 08:36:31.157 917588 3637864 2163017 22 2163016 2163017 5 3670614 3707951 3707952 3707953 3707954 3707955 6 2008-05-07 09:57:14.667 2008-05-07 14:16:31.953 3637866 3637868 3637870 3637873 3637900 698 22 917532 22 5 695 3342849 3342850 1343567 7 2007-01-25 13:56:07.397 2008-01-16 17:09:08.490 699 700 701 702 729 3113202 6946832 22 22 5 6979600 9438052 9438053 9 2008-10-23 17:00:01.580 2009-02-24 16:06:53.450 6946834 6946836 6946839 6946840 7766055 9371865 9371867 9371870 7110657 7110658 7110659 11599875 9372210 22 22 5 9404948 7 2009-03-11 16:58:27.840 2009-03-26 09:36:00.647 9372214 9372215 9372218 9372388 9372390 9372391 9502896 32784 theme.key ]]> 32785 logo signature_220_sm.pct image ]]> 32786 EITS false custom ]]> 22 581 599 604 659 698 769 937 589928 2163016 3113551 6258828 6946832 9372210 9372496 5 20 10458032 10458033 10458034 10458035 10458036 10458037 10458038 10458039 10458040 10458041 10458042 10458043 10458044 10458045 10458046 10458047 10458048 10458049 10458050 10458051 10458052 10458053 10458054 10458055 10458056 10458057 10458058 8 9 10 204 222 223 253 753667 1343568 1343570 4849670 15335431 93 2006-10-18 08:21:22.650 2009-08-06 13:11:25.967 579 580 598 603 605 610 658 668 696 697 768 936 976 589927 917531 917536 917565 917567 917568 917569 2163015 2163053 2163054 2163055 2163056 2163058 2163059 2163066 3113025 3113026 3113222 3113503 3113504 3113505 3113548 3113549 3113557 3113722 3113723 3113732 3637745 3637747 3637749 3637751 3637752 3637754 3637755 3637783 3637784 3637954 3637965 6258813 6258815 6258827 6258834 6258852 6258876 6258878 6258880 6258882 6258883 6258884 6258891 6258894 6258955 6258956 6258957 6259299 6259300 6259310 6259312 6259314 6259329 6259345 6259346 6259348 6946817 6946827 6946837 7766054 7766056 8913341 9371869 9371872 9372221 9372222 9372493 9372494 9372506 9798539 9798553 10355736 1048586 1048587 2326550 2326551 3309621 3735588 6291589 6291590 6291595 12320769 6291594 6291591 6291592 6291593 19234835 946 937 22 937 5 943 5506187 753668 7 2007-02-21 14:45:41.660 2008-06-23 10:31:07.643 1066 163847 589909 5374394 5374395 5374396 917527 589928 22 589928 5 950294 983319 983320 983321 983322 983323 983324 4 2007-05-09 10:15:20.267 2007-05-09 13:15:24.327 917528 917529 917530 3638049 3113115 22 2163016 3113115 5 3670796 9 2008-05-12 12:14:25.300 2008-10-21 10:09:25.297 3638051 3638053 3638055 3638057 3638070 6258858 6258873 6259422 3735608 3735609 3735610 3735611 3735612 3735613 3735614 3735615 3735616 3735617 3735618 589949 769 22 769 5 622712 8454523 8 2007-04-16 16:20:48.017 2009-01-08 15:08:26.227 1835053 2163082 3113609 3113611 8355977 8355978 8355980 2031622 8519690 917543 589928 1179745 22 589928 5 950310 983414 983415 983416 983417 983418 983419 983420 983421 3 2007-05-11 11:07:25.223 2007-05-14 08:39:37.667 917544 917545 589939 589928 22 589928 5 622704 656340 656341 656342 656343 656344 656345 656346 3 2007-04-12 10:36:43.443 2007-04-12 11:07:39.130 589942 589943 9372496 22 22 5 9405227 9441573 9441574 9441575 9441576 9441577 7 2009-04-03 11:06:41.540 2009-04-03 11:19:03.113 9372499 9372501 9372503 9372505 9372507 9372508 3113242 1179679 22 698 917532 1179679 5 3178759 26 2008-01-17 15:30:48.920 2010-10-05 16:55:04.647 3113246 3113327 3113476 3113478 3113480 3113482 6258954 9798541 9798545 9798549 9798564 9798566 9798567 9798571 9798572 9798575 9798576 9798578 9798580 9798581 9798584 10355099 10355315 15204358 15204359 917532 698 1179679 3113134 22 698 5 950299 3342856 3342857 26 2007-05-10 15:13:11.397 2008-01-17 11:47:01.403 917533 917534 917535 917537 917538 917539 917540 917593 917594 1179671 1179672 1179678 1179680 1179682 1179761 1179762 1179768 1179805 2162963 2162964 2162965 2162966 2162967 3113136 3113215 3113240 1179679 22 698 917532 1179679 5 3178758 6325024 6325025 17 2008-01-17 15:30:30.480 2008-08-21 18:07:40.183 3113244 3113245 3113249 3113257 3113259 3113261 3113263 3113344 3113345 3113473 3113474 3113486 3113487 3637976 6258846 6258952 3309588 3309589 3309590 3309591 3309592 3309593 3309594 3309595 3309596 3309597 3309598 1039 1036 8 2007-03-01 08:35:46.057 2007-03-01 13:21:12.223 1023 3309579 659 2008-01-11 10:25:17.103 2008-01-11 10:25:17.103 4885 1 3309580 659 2008-01-11 10:25:33.140 2008-01-11 10:27:20.803 99030 1 1038 1035 7 2007-03-01 08:35:46.057 2007-03-01 10:26:55.677 1023 3113503 3179003 32 2006-10-18 08:21:22.650 2008-01-17 11:53:28.013 22 3113504 3179004 33 2006-10-18 08:21:22.650 2008-02-06 16:06:06.513 22 3113505 3179005 34 2006-10-18 08:21:22.650 2008-02-06 16:06:39.197 22 3113506 3179006 52 2008-01-14 13:21:45.133 2008-01-31 13:45:58.950 3113115 3309595 3113240 2008-01-17 15:52:38.107 2008-01-17 15:52:38.107 37822 1 3309594 3113240 2008-01-17 15:52:32.777 2008-01-17 15:52:32.777 38921 1 21 5 19 1 2006-10-18 08:21:22.647 2006-10-18 08:21:22.647 8749058 3309597 3113240 2008-01-17 15:52:46.843 2008-01-17 15:52:46.843 40993 1 3309596 3113240 2008-01-17 15:52:42.537 2008-01-17 15:52:42.537 37026 1 3309591 3113240 2008-01-17 15:52:04.233 2008-01-17 15:52:04.233 37116 1 3309590 3113240 2008-01-17 15:51:50.417 2008-01-17 15:51:50.417 30138 1 3309593 3113240 2008-01-17 15:52:19.613 2008-01-17 15:52:19.613 38914 1 3309592 3113240 2008-01-17 15:52:13.147 2008-01-17 15:52:13.147 40936 1 950294 dhugal@jamstec.go.jp, let him know to translate/forward to GODAC) **# How do you annotate an animal you are unsure of? **# Is there a way to make the interface in Japanese? **# Is a history of changes tracked? ]]> 917527 3113487 3178992 13 2008-01-17 15:30:30.480 2008-02-05 12:22:49.213 3113240 1212512 1179745 3309586 3113097 2008-01-16 11:25:41.497 2008-01-16 11:25:41.497 101632 1 3309589 3113240 2008-01-17 15:51:43.617 2008-01-17 15:51:43.617 17542 1 1066 1063 1 2007-02-21 14:45:41.660 2007-02-21 14:45:41.660 946 3309588 3113240 2008-01-17 15:48:53.590 2008-01-17 15:48:53.590 574474 1 950299 917532 3309583 3113134 2008-01-15 11:46:46.813 2008-01-15 11:46:46.813 104485 1 3113486 3178991 12 2008-01-17 15:30:30.480 2008-02-05 10:48:05.787 3113240 3309584 3113134 2008-01-15 11:46:56.437 2008-01-15 11:46:56.437 73425 1 3309612 3113115 2008-01-30 12:20:11.537 2008-01-30 12:20:11.537 1677 1 3113482 3178987 6 2008-01-17 15:30:48.920 2008-02-05 11:47:09.190 3113242 3113480 3178985 5 2008-01-17 15:30:48.920 2008-02-05 11:45:50.970 3113242 950310 917543 3113478 3178983 4 2008-01-17 15:30:48.920 2008-02-05 11:42:31.790 3113242 3113476 3178981 3 2008-01-17 15:30:48.920 2008-01-29 15:24:22.373 3113242 3113473 3178978 10 2008-01-17 15:30:30.480 2008-01-30 11:25:58.660 3113240 3113474 3178979 11 2008-01-17 15:30:30.480 2008-02-05 10:47:38.887 3113240 3309598 3113240 2008-01-17 15:56:46.347 2008-01-17 15:56:46.347 39003 1 1025 1022 2 2007-03-01 08:35:46.057 2007-03-01 08:40:53.100 1023 1024 1021 1 2007-03-01 08:35:46.057 2007-03-01 08:35:46.057 1023 3309622 3113551 2008-02-13 10:30:40.993 2008-02-13 10:30:40.993 61467 1 3309621 22 2008-02-06 16:05:49.953 2008-02-06 16:05:49.953 32231 1 1034 1031 6 2007-03-01 08:35:46.057 2007-03-01 10:23:29.177 1023 1033 1030 5 2007-03-01 08:35:46.057 2007-03-01 09:21:54.860 1023 3309616 3113115 2008-01-30 15:47:26.453 2008-01-30 15:47:26.453 152909 1 3309615 1028 1025 4 2007-03-01 08:35:46.057 2007-03-01 09:17:24.780 1023 3309615 3113115 2008-01-30 15:47:26.453 2008-01-30 15:49:40.287 151817 2 1027 1024 3 2007-03-01 08:35:46.057 2007-03-01 08:49:42.897 1023 3309614 3113115 2008-01-30 15:43:40.230 2008-01-30 15:43:40.230 74942 1 1099 1096 17 2007-02-21 14:32:30.070 2007-03-08 11:44:05.670 938 3113571 3179070 54 2008-01-14 13:21:45.133 2008-02-13 15:04:56.783 3113115 3113573 3179072 55 2008-01-14 13:21:45.133 2008-02-13 15:07:25.753 3113115 3113575 3179074 56 2008-01-14 13:21:45.133 2008-02-13 15:11:05.210 3113115 3113576 3179075 57 2008-01-14 13:21:45.133 2008-02-13 15:17:34.430 3113115 3113578 3179077 58 2008-01-14 13:21:45.133 2008-02-13 15:18:01.557 3113115 3309631 3113551 2008-02-20 16:19:25.497 2008-02-20 16:19:25.497 104769 1 950349 917583 6291503 6258944 2008-08-21 18:07:05.907 2008-08-21 18:07:05.907 101632 1 3113569 3179068 53 2008-01-14 13:21:45.133 2008-02-06 16:10:25.240 3113115 3113555 3179054 2 2008-02-13 10:24:08.407 2008-02-13 10:32:44.910 3113551 3113557 3179056 37 2006-10-18 08:21:22.650 2008-02-13 10:22:12.693 22 3113559 3179058 3 2008-02-13 10:24:08.407 2008-02-13 10:38:06.817 3113551 3113548 3179048 35 2006-10-18 08:21:22.650 2008-02-06 16:07:05.507 22 3113549 3179049 36 2006-10-18 08:21:22.650 2008-02-13 10:20:11.917 22 1212447 1179679 3113553 3179052 1 2008-02-13 10:24:08.407 2008-02-13 10:24:08.407 3113551 3707951 3637864 2008-05-07 14:16:31.983 2008-05-07 14:16:31.983 3707954 3637864 2008-05-07 14:16:31.983 2008-05-07 14:16:31.983 1073 1070 9 2007-03-01 08:35:46.057 2007-03-01 13:24:07.293 1023 3707955 3637864 2008-05-07 14:16:31.983 2008-05-07 14:16:31.983 1074 1071 10 2007-03-01 08:35:46.057 2007-03-07 13:31:56.177 1023 3707952 3637864 2008-05-07 14:16:31.983 2008-05-07 14:16:31.983 3707953 3637864 2008-05-07 14:16:31.983 2008-05-07 14:16:31.983 1081 1078 6 2007-02-21 14:32:30.070 2007-02-21 14:42:49.977 938 1082 1079 7 2007-02-21 14:32:30.070 2007-03-07 15:55:33.530 938 1080 1077 11 2007-03-01 08:35:46.057 2007-03-07 13:50:37.050 1023 1085 1082 10 2007-02-21 14:32:30.070 2007-03-07 16:05:03.240 938 1084 1081 9 2007-02-21 14:32:30.070 2007-03-07 16:02:47.490 938 1083 1080 8 2007-02-21 14:32:30.070 2007-03-07 16:02:03.473 938 1090 1087 14 2007-02-21 14:32:30.070 2007-03-07 16:22:09.180 938 1089 1086 13 2007-02-21 14:32:30.070 2007-03-07 16:12:11.593 938 1088 1085 12 2007-02-21 14:32:30.070 2007-03-07 16:09:46.267 938 1087 1084 11 2007-02-21 14:32:30.070 2007-03-07 16:05:14.857 938 12288007 3637958 2010-05-10 16:28:11.713 2010-05-10 16:28:11.713 3342687 3113106 2008-01-14 09:13:18.773 2008-01-14 09:13:18.773 3342686 3113106 2008-01-14 09:13:18.773 2008-01-14 09:13:18.773 3342689 3113106 2008-01-14 09:13:18.773 2008-01-14 09:13:18.773 3342688 3113106 2008-01-14 09:13:18.773 2008-01-14 09:13:18.773 1096 1093 16 2007-02-21 14:32:30.070 2007-03-08 10:43:08.047 938 1095 1092 15 2007-02-21 14:32:30.070 2007-03-07 16:22:55.613 938 12288008 3637958 2010-05-10 16:28:11.713 2010-05-10 16:28:11.713 2195780 2163016 2195781 2163017 3637670 3670425 76 2008-01-14 13:21:45.133 2008-04-24 12:49:41.507 3113115 3637668 3670423 75 2008-01-14 13:21:45.133 2008-02-21 10:55:07.697 3113115 3113611 3179110 4 2007-04-16 16:20:48.017 2008-02-14 11:29:28.897 589949 3637674 3670429 78 2008-01-14 13:21:45.133 2008-04-24 13:05:00.533 3113115 21364757 9798548 21397525 1 2013-05-21 11:11:45.000 2013-05-21 11:11:45.000 3637672 3670427 77 2008-01-14 13:21:45.133 2008-04-24 13:03:04.513 3113115 3113601 3179100 70 2008-01-14 13:21:45.133 2008-02-13 16:18:50.090 3113115 2195811 2163047 3113599 3179098 69 2008-01-14 13:21:45.133 2008-02-13 16:17:33.480 3113115 3113597 3179096 68 2008-01-14 13:21:45.133 2008-02-13 16:14:12.407 3113115 11240270 11273010 136 2008-01-14 13:21:45.133 2010-03-05 10:13:03.590 3113115 3113595 3179094 67 2008-01-14 13:21:45.133 2008-02-13 16:06:35.597 3113115 11240268 11273008 135 2008-01-14 13:21:45.133 2009-01-23 11:50:34.980 3113115 6326081 6259292 2008-10-06 11:16:43.527 2008-10-06 11:16:43.527 3113609 3179108 3 2007-04-16 16:20:48.017 2007-12-19 10:08:22.067 589949 3113607 3179106 73 2008-01-14 13:21:45.133 2008-02-13 16:24:20.637 3113115 3113605 3179104 72 2008-01-14 13:21:45.133 2008-02-13 16:21:58.100 3113115 2195824 2163060 3113603 3179102 71 2008-01-14 13:21:45.133 2008-02-13 16:21:09.003 3113115 3113585 3179084 62 2008-01-14 13:21:45.133 2008-02-13 15:57:53.193 3113115 3113583 3179082 61 2008-01-14 13:21:45.133 2008-02-13 15:20:47.043 3113115 3113581 3179080 60 2008-01-14 13:21:45.133 2008-02-13 15:19:58.683 3113115 3113579 3179078 59 2008-01-14 13:21:45.133 2008-02-13 15:18:52.787 3113115 3113593 3179092 66 2008-01-14 13:21:45.133 2008-02-13 16:04:54.087 3113115 3113592 3179091 65 2008-01-14 13:21:45.133 2008-02-13 16:04:00.353 3113115 3113590 3179089 64 2008-01-14 13:21:45.133 2008-02-13 16:00:33.420 3113115 3113587 3179086 63 2008-01-14 13:21:45.133 2008-02-13 15:58:59.337 3113115 10 2 22 2006-10-25 10:15:15.090 2006-11-01 10:23:15.057 8 2 22 2006-10-24 15:59:15.023 2006-10-24 16:04:15.070 9 2 22 2006-10-24 16:15:15.030 2006-11-01 10:25:15.017 9831292 /view_client-2.0-Any-Java.tar.Z . [root@nanomia condor] tar -zxvf view_client-2.0-Any-Java.tar.Z [root@nanomia condor] tar -xvf view_client.tar {noformat} * Edit make_stats, changing ORGNAME, CONDORADMIN, etc. to reflect the installation, then run the installation {noformat} [root@nanomia condor] ./make_stats setup [root@nanomia condor] crontab cronentries {noformat} * The page should be visible [http://nanomia.shore.mbari.org/condor-view-applet/condor/condorview/]. h2. MBARI Mail setup Condor can be configured to email to users on job completion, or failure. By default the root user will receive any emails if the condor daemons go awry. The following instructions are to setup the machine to correctly forward the emails. To send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat} [root@nanomia condor]# yum install sendmail-cf {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, then skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dcline@mbari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 9798548 8159309 2163017 2007-12-06 13:32:20.733 2007-12-14 16:20:39.797 3061 2 2326549 3342821 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 3342820 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 3342823 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 3342822 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 3342825 589928 2008-01-16 11:15:52.863 2008-01-16 11:15:52.863 3342824 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 3342826 589928 2008-01-16 11:15:52.863 2008-01-16 11:15:52.863 3342812 3113110 2008-01-16 11:14:33.620 2008-01-16 11:14:33.620 3342813 3113110 2008-01-16 11:14:33.620 2008-01-16 11:14:33.620 3342814 3113110 2008-01-16 11:14:33.620 2008-01-16 11:14:33.620 3342815 3113110 2008-01-16 11:14:33.620 2008-01-16 11:14:33.620 3342816 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 3342817 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 3342818 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 6291588 6259292 2008-10-06 11:16:15.537 2008-10-06 11:16:15.537 4324701 1 6291589 22 2008-10-07 12:45:46.407 2010-05-11 11:16:15.497 340418 4 3342819 589928 2008-01-16 11:15:52.860 2008-01-16 11:15:52.860 6291590 22 2008-10-07 12:45:46.407 2008-10-07 12:45:46.407 1580855 1 6291589 6291591 22 2008-10-07 14:07:14.593 2008-10-13 12:08:40.227 79647 2 6291592 22 2008-10-07 14:14:45.620 2008-10-13 12:07:42.717 655872 2 6291593 22 2008-10-07 14:14:45.620 2008-10-07 14:14:45.620 403968 1 6291592 6291594 22 2008-10-07 14:07:14.593 2008-10-07 14:07:14.593 79647 1 6291591 6291595 22 2008-10-07 12:45:46.407 2008-10-07 12:52:40.010 1631654 2 6291589 3113720 3179218 8 2008-02-13 10:24:08.407 2008-02-20 16:19:36.300 3113551 3113722 3179220 38 2006-10-18 08:21:22.650 2008-02-13 10:39:43.943 22 3113721 3179219 9 2008-02-13 10:24:08.407 2008-02-20 16:21:15.447 3113551 3113716 3179214 6 2008-02-13 10:24:08.407 2008-02-20 16:09:24.917 3113551 3113715 3179213 5 2008-02-13 10:24:08.407 2008-02-20 16:08:52.493 3113551 3113718 3179216 7 2008-02-13 10:24:08.407 2008-02-20 16:09:46.220 3113551 983649 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 983648 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 983651 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 983650 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 3113713 3179211 4 2008-02-13 10:24:08.407 2008-02-13 10:52:00.330 3113551 983647 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 983656 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 5506187 946 2008-06-23 10:31:07.650 2008-06-23 10:31:07.650 983657 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 3113736 3179234 15 2007-12-05 08:57:43.203 2008-01-11 16:52:10.497 2163017 983658 917583 2007-05-24 08:36:31.220 2007-05-24 08:36:31.220 983659 917583 2007-05-24 08:36:31.220 2007-05-24 08:36:31.220 983652 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 3113732 3179230 40 2006-10-18 08:21:22.650 2008-02-20 16:51:40.417 22 983653 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 983654 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 983655 917583 2007-05-24 08:36:31.217 2007-05-24 08:36:31.217 3113723 3179221 39 2006-10-18 08:21:22.650 2008-02-20 16:21:52.227 22 983660 917583 2007-05-24 08:36:31.220 2007-05-24 08:36:31.220 3113726 3179224 74 2008-01-14 13:21:45.133 2008-02-13 16:49:01.807 3113115 5506261 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506260 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506263 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 1343571 1 163852 2007-08-24 15:46:15.130 2007-08-24 15:46:15.130 1343570 1 22 2007-08-24 15:46:15.127 2007-08-24 15:46:15.127 5506262 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506265 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506264 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506267 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506266 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506269 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506268 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506271 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506270 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506273 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 1343569 1 769 2007-08-24 15:46:15.057 2007-08-24 15:46:15.057 1343568 1 22 2007-08-23 10:38:15.107 2007-08-23 10:38:15.107 5506272 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506275 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 1343567 1 698 2007-08-23 10:38:15.050 2007-08-23 10:38:15.050 5506274 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 19166910 9798548 2012-11-07 15:24:08.267 2012-11-07 15:24:08.267 5506276 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506277 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 19166908 9798548 2012-11-07 15:24:08.267 2012-11-07 15:24:08.267 19166909 9798548 2012-11-07 15:24:08.267 2012-11-07 15:24:08.267 5506258 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506259 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506256 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 5506257 938 2008-06-23 10:54:58.567 2008-06-23 10:54:58.567 917558 950325 16 2007-03-12 11:17:25.610 2007-05-18 16:42:13.067 163852 917557 950324 15 2007-03-12 11:17:25.610 2007-05-18 16:39:57.280 163852 10455520 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 917556 950323 14 2007-03-12 11:17:25.610 2007-05-03 13:38:31.097 163852 917555 950322 6 2007-04-11 09:50:01.490 2007-05-18 16:28:55.440 589928 10455518 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455519 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 917561 950328 18 2007-03-12 11:17:25.610 2007-05-18 16:45:54.713 163852 10455516 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455517 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 917559 950326 17 2007-03-12 11:17:25.610 2007-05-18 16:45:40.877 163852 10455514 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455515 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455512 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455513 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 917554 950321 5 2007-04-11 09:50:01.490 2007-05-18 16:28:45.417 589928 10455510 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 917553 950320 4 2007-04-11 09:50:01.490 2007-05-11 11:00:40.657 589928 10455511 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455508 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455509 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 9900272 1179679 2009-05-15 13:15:52.583 2009-05-15 13:15:52.583 656441 769 2007-04-18 05:10:14.637 2007-04-18 05:10:14.637 9900273 1179679 2009-05-15 13:15:52.583 2009-05-15 13:15:52.583 656440 769 2007-04-18 05:10:14.637 2007-04-18 05:10:14.637 9900274 1179679 2009-05-15 13:15:52.583 2009-05-15 13:15:52.583 656443 769 2007-04-18 05:10:14.637 2007-04-18 05:10:14.637 656442 769 2007-04-18 05:10:14.637 2007-04-18 05:10:14.637 9900271 1179679 2009-05-15 13:15:52.583 2009-05-15 13:15:52.583 917565 950332 17 2006-10-18 08:21:22.650 2007-05-10 15:19:53.880 22 917566 950333 44 2007-02-21 14:32:30.070 2007-05-11 09:13:41.450 938 917563 950330 19 2007-03-12 11:17:25.610 2007-05-21 10:59:56.333 163852 13926732 13959494 21 2009-05-15 13:14:57.057 2010-08-04 16:39:41.210 9798548 917569 950336 20 2006-10-18 08:21:22.650 2007-05-22 12:21:08.847 22 917567 950334 18 2006-10-18 08:21:22.650 2007-05-21 13:00:52.320 22 917568 950335 19 2006-10-18 08:21:22.650 2007-05-22 11:35:37.927 22 917588 950354 1 2007-05-23 14:01:46.997 2007-05-23 14:01:46.997 917583 917587 950353 5 2007-02-05 16:00:22.540 2007-05-23 16:36:09.187 789 13926730 13959492 20 2009-05-15 13:14:57.057 2010-08-04 16:01:32.213 9798548 917594 950360 9 2007-05-10 15:13:11.397 2007-05-25 10:33:57.987 917532 13926724 13959486 19 2009-05-15 13:14:57.057 2010-08-04 15:25:15.227 9798548 917593 950359 8 2007-05-10 15:13:11.397 2007-05-10 17:11:35.243 917532 917581 950348 7 2007-04-11 09:50:01.490 2007-05-18 16:30:10.120 589928 13926717 13959479 18 2009-05-15 13:14:57.057 2010-08-03 15:35:51.537 9798548 917586 950352 4 2007-02-05 16:00:22.540 2007-02-06 11:15:45.677 789 10455505 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455504 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455507 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455506 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455501 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455500 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455503 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 10455502 1023 2009-06-04 12:42:53.097 2009-06-04 12:42:53.097 7110658 6946832 2008-10-23 17:15:47.737 2008-10-23 17:15:47.737 62322 1 7110659 6946832 2008-10-23 17:34:36.153 2008-10-23 17:34:36.153 84537 1 13926701 13959463 17 2009-05-15 13:14:57.057 2010-08-03 15:35:34.060 9798548 13926700 13959462 16 2009-05-15 13:14:57.057 2010-03-30 13:20:08.997 9798548 7110657 6946832 2008-10-23 17:06:47.277 2008-10-23 17:06:47.277 56136 1 657 604 654 1 2007-01-19 15:56:28.853 2007-01-19 15:56:28.853 917511 950279 9 2007-03-12 11:17:25.610 2007-05-02 13:16:47.830 163852 917509 950277 7 2007-03-12 11:17:25.610 2007-04-18 05:25:48.963 163852 917510 950278 8 2007-03-12 11:17:25.610 2007-05-02 13:14:51.637 163852 917507 950275 34 2007-02-21 14:32:30.070 2007-04-18 11:51:49.237 938 917508 950276 35 2007-02-21 14:32:30.070 2007-04-30 16:18:04.963 938 917505 950273 27 2007-02-05 15:44:32.787 2007-04-16 16:25:56.807 780 917506 950274 28 2007-02-05 15:44:32.787 2007-04-30 15:48:22.740 780 9437186 8913021 2009-02-17 11:11:54.447 2009-02-17 11:11:54.447 917528 950295 1 2007-05-09 10:15:20.267 2007-05-09 10:15:20.267 917527 917530 950297 3 2007-05-09 10:15:20.267 2007-05-09 13:14:35.847 917527 9437185 8913021 2009-02-17 11:11:54.363 2009-02-17 11:11:54.363 917529 950296 2 2007-05-09 10:15:20.267 2007-05-09 10:16:31.643 917527 917524 950291 41 2007-02-21 14:32:30.070 2007-05-07 13:57:49.460 938 917523 950290 40 2007-02-21 14:32:30.070 2007-05-07 13:49:56.727 938 9502896 9372210 2009-03-11 17:02:37.147 2009-03-11 17:02:37.147 56136 1 917526 950293 2 2007-04-11 09:50:01.490 2007-04-12 10:36:31.053 589928 917525 950292 42 2007-02-21 14:32:30.070 2007-05-07 14:14:18.590 938 917520 950287 37 2007-02-21 14:32:30.070 2007-05-07 13:29:47.670 938 917519 950286 36 2007-02-21 14:32:30.070 2007-04-30 16:18:54.117 938 917522 950289 39 2007-02-21 14:32:30.070 2007-05-07 13:46:27.677 938 9441576 9372496 2009-04-03 11:19:03.130 2009-04-03 11:19:03.130 917521 950288 38 2007-02-21 14:32:30.070 2007-05-07 13:41:27.637 938 9441577 9372496 2009-04-03 11:19:03.130 2009-04-03 11:19:03.130 917516 950283 11 2007-03-12 11:17:25.610 2007-05-02 18:19:57.107 163852 9441574 9372496 2009-04-03 11:19:03.130 2009-04-03 11:19:03.130 917515 950282 10 2007-03-12 11:17:25.610 2007-05-02 15:43:39.840 163852 9441575 9372496 2009-04-03 11:19:03.130 2009-04-03 11:19:03.130 917518 950285 13 2007-03-12 11:17:25.610 2007-05-03 13:37:40.537 163852 917517 950284 12 2007-03-12 11:17:25.610 2007-05-03 13:36:02.017 163852 9441573 9372496 2009-04-03 11:19:03.130 2009-04-03 11:19:03.130 11796495 11829262 13 2009-05-15 13:14:57.057 2009-05-21 17:00:31.200 9798548 917544 950311 1 2007-05-11 11:07:25.223 2007-05-11 11:07:25.223 917543 11796497 11829264 14 2009-05-15 13:14:57.057 2010-03-30 13:16:03.233 9798548 917545 950312 2 2007-05-11 11:07:25.223 2007-05-11 11:10:03.250 917543 11796498 11829265 15 2009-05-15 13:14:57.057 2010-03-30 13:17:21.490 9798548 917539 950306 6 2007-05-10 15:13:11.397 2007-05-10 15:44:37.110 917532 917540 950307 7 2007-05-10 15:13:11.397 2007-05-10 17:08:41.233 917532 917541 950308 43 2007-02-21 14:32:30.070 2007-05-07 14:19:12.507 938 917542 950309 3 2007-04-11 09:50:01.490 2007-05-09 10:02:48.960 589928 917535 950302 3 2007-05-10 15:13:11.397 2007-05-10 15:17:45.243 917532 917536 950303 16 2006-10-18 08:21:22.650 2007-05-10 15:03:57.807 22 917537 950304 4 2007-05-10 15:13:11.397 2007-05-10 15:19:02.920 917532 917538 950305 5 2007-05-10 15:13:11.397 2007-05-10 15:20:11.177 917532 917531 950298 15 2006-10-18 08:21:22.650 2007-04-11 09:49:46.007 22 917533 950300 1 2007-05-10 15:13:11.397 2007-05-10 15:13:11.397 917532 917534 950301 2 2007-05-10 15:13:11.397 2007-05-10 15:15:59.143 917532 163845 294916 21 2007-02-21 14:32:30.070 2007-03-09 11:02:36.170 938 163846 294917 22 2007-02-21 14:32:30.070 2007-03-09 11:04:21.480 938 1179680 1212448 13 2007-05-10 15:13:11.397 2007-06-07 15:41:43.207 917532 1179681 1212449 1 2007-06-07 15:42:27.210 2007-06-07 15:42:27.210 1179679 163843 294914 19 2007-02-21 14:32:30.070 2007-03-09 10:14:50.103 938 163844 294915 20 2007-02-21 14:32:30.070 2007-03-09 10:20:00.220 938 1179682 1212450 14 2007-05-10 15:13:11.397 2007-06-07 15:43:52.433 917532 163849 294920 24 2007-02-05 15:44:32.787 2007-02-07 11:39:23.303 780 163847 294918 2 2007-02-21 14:45:41.660 2007-03-07 10:39:49.997 946 163848 294919 23 2007-02-21 14:32:30.070 2007-03-09 11:05:31.420 938 1179678 1212446 12 2007-05-10 15:13:11.397 2007-06-05 10:56:51.290 917532 1179687 1212455 6 2007-06-07 15:42:27.210 2007-06-07 16:55:49.097 1179679 3029 581 2007-01-23 11:31:36.437 2007-01-23 11:31:36.437 1179683 1212451 2 2007-06-07 15:42:27.210 2007-06-07 15:58:39.027 1179679 1179684 1212452 3 2007-06-07 15:42:27.210 2007-06-07 16:19:48.480 1179679 163842 294913 18 2007-02-21 14:32:30.070 2007-03-08 16:48:41.037 938 1179685 1212453 4 2007-06-07 15:42:27.210 2007-06-07 16:21:11.170 1179679 1179686 1212454 5 2007-06-07 15:42:27.210 2007-06-07 16:51:17.397 1179679 3670796 website_ !Picture 2.png|align=center! # A wizard will open, click next, then enter the description as _EITS Computer,_ then select Next !Picture 3.png|align=center! # Choose the mbari address 134.*.*.\* , then select Next !Picture 4.png|align=center! # Enter _C:\wwwroot_ for the root path of the home directory !Picture 5.png|align=center! # Select Read and Browse permissions, then select Next and click Finish on the final window. !Picture 6.png|align=center!\\ h1. Add a Virtual Directory to the RAID to make it visible for http access # Login as *Administrator.* # In the "Manage Your Server" window that opens at login, select _Manage this application Server_ !Picture 1.png|align=center! # Select New->VirtualDirectory !Picture 7.png|align=center! # A wizard will come up, and select next. Enter e for the alias to the E: drive !Picture 8.png|align=center! # Enter E:\ For the path to the directory that contains the contents !Picture 9.png|align=center! # Select Read and Browse permissions !Picture 10.png|align=center! Click Finish on the next window and you are done. The virtual directory should now show up as http:\\eits.shore.mbari.org\e in your web browser. ]]> 3638049 1179672 1212440 11 2007-05-10 15:13:11.397 2007-06-05 10:54:22.590 917532 1179671 1212439 10 2007-05-10 15:13:11.397 2007-05-25 10:34:13.223 917532 3178695 3113176 20 22 32 1 938 2007-03-07 15:56:09.000 2007-03-07 15:56:09.000 29 20 604 2007-02-14 14:03:15.417 2007-02-14 14:03:15.417 6226052 6258828 163869 294940 26 2007-02-21 14:32:30.070 2007-03-12 14:03:04.690 938 33 22 938 2007-03-07 16:30:09.597 2007-03-07 16:30:09.597 163851 294922 1 2007-02-05 14:31:16.673 2007-02-05 14:31:16.673 769 163853 294924 12 2007-03-01 08:35:46.057 2007-03-07 15:49:10.967 1023 163856 294927 25 2007-02-21 14:32:30.070 2007-03-12 14:02:30.997 938 163855 294926 24 2007-02-21 14:32:30.070 2007-03-09 16:29:44.013 938 1245546 1179745 2007-06-22 15:36:39.370 2007-06-22 15:36:39.370 1245547 1179745 2007-06-22 15:36:39.370 2007-06-22 15:36:39.370 1245544 1179745 2007-06-22 15:36:39.370 2007-06-22 15:36:39.370 1245545 1179745 2007-06-22 15:36:39.370 2007-06-22 15:36:39.370 3178654 3113134 1179746 1212513 1 2007-06-22 15:11:59.833 2007-06-22 15:11:59.833 1179745 1179747 1212514 2 2007-06-22 15:11:59.833 2007-06-22 15:26:17.903 1179745 1179748 1212515 3 2007-06-22 15:11:59.833 2007-06-22 15:30:18.923 1179745 1179749 1212516 8 2007-04-11 09:50:01.490 2007-05-23 13:47:59.287 589928 1245548 1179745 2007-06-22 15:36:39.370 2007-06-22 15:36:39.370 1245549 1179745 2007-06-22 15:36:39.370 2007-06-22 15:36:39.370 983323 917527 2007-05-09 13:15:24.337 2007-05-09 13:15:24.337 983322 917527 2007-05-09 13:15:24.337 2007-05-09 13:15:24.337 983321 917527 2007-05-09 13:15:24.337 2007-05-09 13:15:24.337 983320 917527 2007-05-09 13:15:24.337 2007-05-09 13:15:24.337 983319 917527 2007-05-09 13:15:24.333 2007-05-09 13:15:24.333 3178637 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. Experiment software * [EITS workflow scripts and cron job installation] * [EITS web service] * [EITS RAID directories] * [EITS cron setup] * [EITS rsync setup] * [EITS streaming setup|EITS:EITS streaming setup]]]> 3113115 3178633 3113110 582 580 1 2007-01-10 13:50:38.427 2007-01-10 13:50:38.427 581 6226165 > ~/.profile {noformat} # Replace the local condor config file with EITS experiment settings in this [^condor_config.local] {noformat} sudo cp condor_config.local /opt/condor-7.4.2/local.somniosus/condor_config.local {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_master {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_off -master {noformat} # Use [Lingon|http://lingon.sourceforge.net/] to create a launchd item to execute {{condor_start.sh}} as a service. !org_mbari_eits_Condor_macLingon.png|thumbnail! # In Lingon, Click expert mode in the bottom right, then add the following {noformat} ... EnvironmentVariables CONDOR_CONFIG /opt/condor-7.4.2/etc/condor_config ... {noformat} ]]> 6258944 580 578 2 2006-10-18 08:21:22.650 2007-01-09 15:22:53.250 22 3178630 3113106 579 577 1 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 22 983324 917527 2007-05-09 13:15:24.337 2007-05-09 13:15:24.337 9371650 9404418 19 2009-01-23 10:33:06.733 2009-02-03 15:02:11.387 8913021 1179713 1212481 22 2007-03-12 11:17:25.610 2007-06-13 11:30:07.703 163852 1179714 1212482 23 2007-03-12 11:17:25.610 2007-06-13 11:30:32.680 163852 1179712 1212480 21 2007-03-12 11:17:25.610 2007-06-11 11:58:43.913 163852 1179717 1212485 9 2007-06-07 15:42:27.210 2007-06-13 13:39:41.547 1179679 600 598 1 2007-01-18 15:38:10.963 2007-01-18 15:38:10.963 599 601 599 2 2007-01-18 15:38:10.963 2007-01-18 15:40:48.620 599 1179715 1212483 7 2007-06-07 15:42:27.210 2007-06-07 17:06:14.813 1179679 1179716 1212484 8 2007-06-07 15:42:27.210 2007-06-13 13:02:24.937 1179679 602 600 3 2007-01-18 15:38:10.963 2007-01-18 15:41:58.363 599 598 596 3 2006-10-18 08:21:22.650 2007-01-09 15:24:59.327 22 608 606 3 2007-01-18 15:59:19.917 2007-01-18 16:01:37.697 604 607 605 2 2007-01-18 15:59:19.917 2007-01-18 16:00:26.193 604 610 608 6 2006-10-18 08:21:22.650 2007-01-18 16:00:26.190 22 609 607 4 2007-01-18 15:59:19.917 2007-01-18 16:06:41.567 604 603 601 4 2006-10-18 08:21:22.650 2007-01-18 15:38:00.637 22 606 604 1 2007-01-18 15:59:19.917 2007-01-18 15:59:19.917 604 605 603 5 2006-10-18 08:21:22.650 2007-01-18 15:57:19.023 22 1179705 1212473 20 2007-03-12 11:17:25.610 2007-05-21 11:26:18.217 163852 9371867 9404616 7 2008-10-23 17:00:01.580 2009-02-24 16:01:39.110 6946832 9371870 9404619 8 2008-10-23 17:00:01.580 2009-02-24 16:03:32.070 6946832 9371869 9404618 83 2006-10-18 08:21:22.650 2009-02-09 09:30:43.863 22 9371872 9404621 84 2006-10-18 08:21:22.650 2009-02-24 16:06:53.390 22 1179805 1212572 18 2007-05-10 15:13:11.397 2007-06-25 15:50:33.547 917532 6258954 6226175 7 2008-01-17 15:30:48.920 2008-02-05 11:52:24.810 3113242 1179799 1212566 13 2007-06-07 15:42:27.210 2007-07-03 10:40:56.343 1179679 6258953 6226174 25 2007-06-07 15:42:27.210 2008-08-21 18:07:40.137 1179679 6258952 6226173 16 2008-01-17 15:30:30.480 2008-08-20 13:19:09.940 3113240 6258950 6226171 24 2007-06-07 15:42:27.210 2008-08-20 13:19:09.910 1179679 649 647 2 2007-01-10 13:50:38.427 2007-01-10 16:44:44.897 581 650 648 3 2007-01-10 13:50:38.427 2007-01-19 10:55:30.300 581 9371865 9404614 6 2008-10-23 17:00:01.580 2008-11-12 17:11:29.190 6946832 6258948 6226169 3 2008-08-21 18:01:47.250 2008-08-21 18:04:44.060 6258944 1179798 1212565 12 2007-06-07 15:42:27.210 2007-06-25 14:58:21.683 1179679 6258946 6226167 2 2008-08-21 18:01:47.250 2008-08-21 18:02:46.203 6258944 6258945 6226166 1 2008-08-21 18:01:47.250 2008-08-21 18:01:47.250 6258944 6258942 6226164 9 2008-01-11 16:50:35.080 2008-01-16 11:41:42.007 3113097 6258941 6226163 17 2007-12-05 08:57:43.203 2008-05-07 09:41:48.580 2163017 6258940 6226162 11 2008-05-08 11:37:22.423 2008-08-21 17:57:35.417 3637958 6258939 6226161 10 2008-05-08 11:37:22.423 2008-08-20 13:41:57.007 3637958 660 657 1 2007-01-19 16:04:18.030 2007-01-19 16:04:18.030 659 662 659 3 2007-01-19 16:04:18.030 2007-01-19 16:07:14.267 659 661 658 2 2007-01-19 16:04:18.030 2007-01-19 16:05:42.083 659 664 661 9 2007-01-10 13:50:38.427 2007-01-19 14:05:36.690 581 663 660 4 2007-01-19 16:04:18.030 2007-01-19 16:08:36.087 659 665 662 10 2007-01-10 13:50:38.427 2007-01-19 16:54:59.717 581 3178621 3113097 652 650 5 2007-01-10 13:50:38.427 2007-01-19 11:32:55.573 581 651 649 4 2007-01-10 13:50:38.427 2007-01-19 11:15:30.663 581 654 651 6 2007-01-10 13:50:38.427 2007-01-19 11:34:24.013 581 6258955 6226176 65 2006-10-18 08:21:22.650 2008-08-20 14:22:25.937 22 656 653 8 2007-01-10 13:50:38.427 2007-01-19 11:43:00.097 581 6258956 6226177 66 2006-10-18 08:21:22.650 2008-08-21 18:08:34.130 22 655 652 7 2007-01-10 13:50:38.427 2007-01-19 11:41:30.573 581 6258957 6226178 67 2006-10-18 08:21:22.650 2008-08-21 18:08:45.523 22 658 655 7 2006-10-18 08:21:22.650 2007-01-18 16:12:34.823 22 9438053 6946832 2009-02-24 16:06:53.457 2009-02-24 16:06:53.457 9438052 6946832 2009-02-24 16:06:53.457 2009-02-24 16:06:53.457 1179768 1212535 17 2007-05-10 15:13:11.397 2007-06-25 14:46:30.883 917532 1179765 1212532 11 2007-06-07 15:42:27.210 2007-06-25 14:57:44.460 1179679 1179764 1212531 10 2007-06-07 15:42:27.210 2007-06-13 13:44:48.763 1179679 682 679 11 2007-01-10 13:50:38.427 2007-01-19 17:01:11.940 581 1179761 1212528 15 2007-05-10 15:13:11.397 2007-06-07 16:01:03.523 917532 1179762 1212529 16 2007-05-10 15:13:11.397 2007-06-25 14:45:53.463 917532 668 665 8 2006-10-18 08:21:22.650 2007-01-19 16:02:20.143 22 15204359 15237127 25 2008-01-17 15:30:48.920 2010-10-05 16:51:00.080 3113242 15204358 15237126 24 2008-01-17 15:30:48.920 2009-07-09 15:27:25.847 3113242 697 694 10 2006-10-18 08:21:22.650 2007-01-25 13:45:31.530 22 696 693 9 2006-10-18 08:21:22.650 2007-01-22 10:45:53.123 22 686 683 12 2007-01-10 13:50:38.427 2007-01-23 09:38:16.287 581 1179859 1212625 52 2007-02-21 14:32:30.070 2007-07-16 16:57:05.707 938 1179860 1212626 53 2007-02-21 14:32:30.070 2007-07-16 16:59:52.000 938 1179861 1212627 54 2007-02-21 14:32:30.070 2007-07-16 17:01:28.077 938 1179862 1212628 55 2007-02-21 14:32:30.070 2007-07-16 17:06:08.387 938 1179863 1212629 56 2007-02-21 14:32:30.070 2007-07-16 17:09:44.240 938 16 599 2007-01-18 15:39:17.707 2007-01-18 15:39:45.097 85197 1 1179864 1212630 57 2007-02-21 14:32:30.070 2007-07-16 17:10:48.763 938 17 599 2007-01-18 15:39:32.737 2007-01-18 15:39:32.737 86359 1 1179865 1212631 58 2007-02-21 14:32:30.070 2007-07-16 17:11:38.110 938 15 599 2007-01-18 15:38:53.210 2007-01-18 15:38:53.210 102402 1 1179851 1212617 29 2007-01-18 15:59:19.917 2007-04-18 05:10:14.673 604 1179852 1212618 45 2007-02-21 14:32:30.070 2007-05-21 15:33:37.387 938 7766055 7798819 5 2008-10-23 17:00:01.580 2008-10-23 17:36:00.140 6946832 1179853 1212619 46 2007-02-21 14:32:30.070 2007-07-16 16:37:45.997 938 703 700 5 2007-01-18 15:59:19.917 2007-01-18 16:07:14.927 604 7766056 7798820 81 2006-10-18 08:21:22.650 2008-11-12 17:11:29.147 22 1179854 1212620 47 2007-02-21 14:32:30.070 2007-07-16 16:48:22.400 938 701 698 3 2007-01-25 13:56:07.397 2007-01-25 14:06:44.577 698 1179855 1212621 48 2007-02-21 14:32:30.070 2007-07-16 16:51:38.797 938 7766054 7798818 80 2006-10-18 08:21:22.650 2008-10-23 17:27:33.513 22 702 699 4 2007-01-25 13:56:07.397 2007-01-25 14:08:01.460 698 1179856 1212622 49 2007-02-21 14:32:30.070 2007-07-16 16:53:56.923 938 699 696 1 2007-01-25 13:56:07.397 2007-01-25 13:56:07.397 698 1179857 1212623 50 2007-02-21 14:32:30.070 2007-07-16 16:54:48.970 938 22 659 2007-01-19 16:55:08.537 2007-01-19 16:55:08.537 260961 1 700 697 2 2007-01-25 13:56:07.397 2007-01-25 14:05:30.673 698 1179858 1212624 51 2007-02-21 14:32:30.070 2007-07-16 16:55:42.520 938 23 581 2007-01-23 09:36:34.030 2007-01-23 09:36:34.030 40448 1 728 725 9 2007-01-18 15:59:19.917 2007-02-02 11:04:29.763 604 727 724 8 2007-01-18 15:59:19.917 2007-02-02 10:42:31.660 604 729 726 5 2007-01-25 13:56:07.397 2007-01-25 14:16:06.657 698 1179850 1212616 28 2007-03-12 11:17:25.610 2007-07-16 16:10:05.383 163852 31 789 2007-02-06 11:15:23.303 2007-02-06 11:15:23.303 91730 1 1179849 1212615 27 2007-03-12 11:17:25.610 2007-07-16 16:07:24.123 163852 30 780 2007-02-05 16:42:13.697 2007-02-05 16:42:29.653 56489 1 1179848 1212614 26 2007-03-12 11:17:25.610 2007-07-16 14:38:23.217 163852 726 723 7 2007-01-18 15:59:19.917 2007-02-02 10:41:25.280 604 725 722 6 2007-01-18 15:59:19.917 2007-01-25 14:18:41.357 604 1179840 1212606 25 2007-03-12 11:17:25.610 2007-07-16 14:37:57.703 163852 1179839 1212605 24 2007-03-12 11:17:25.610 2007-06-13 11:32:03.090 163852 744 741 19 2007-01-18 15:59:19.917 2007-02-02 14:52:34.657 604 983420 917543 2007-05-14 08:39:37.720 2007-05-14 08:39:37.720 739 736 18 2007-01-18 15:59:19.917 2007-02-02 14:51:35.203 604 983421 917543 2007-05-14 08:39:37.720 2007-05-14 08:39:37.720 983416 917543 2007-05-14 08:39:37.720 2007-05-14 08:39:37.720 735 732 14 2007-01-18 15:59:19.917 2007-02-02 14:41:26.853 604 983417 917543 2007-05-14 08:39:37.720 2007-05-14 08:39:37.720 736 733 15 2007-01-18 15:59:19.917 2007-02-02 14:42:25.150 604 983418 917543 2007-05-14 08:39:37.720 2007-05-14 08:39:37.720 737 734 16 2007-01-18 15:59:19.917 2007-02-02 14:50:14.777 604 10355099 10387836 22 2008-01-17 15:30:48.920 2009-05-15 16:38:53.400 3113242 983419 917543 2007-05-14 08:39:37.720 2007-05-14 08:39:37.720 738 735 17 2007-01-18 15:59:19.917 2007-02-02 14:50:56.153 604 731 728 10 2007-01-18 15:59:19.917 2007-02-02 11:49:06.440 604 732 729 11 2007-01-18 15:59:19.917 2007-02-02 12:19:03.477 604 983414 917543 2007-05-14 08:39:37.720 2007-05-14 08:39:37.720 15335431 2 22 2010-10-12 10:40:15.097 2010-10-12 10:40:15.097 733 730 12 2007-01-18 15:59:19.917 2007-02-02 12:20:00.480 604 983415 917543 2007-05-14 08:39:37.720 2007-05-14 08:39:37.720 734 731 13 2007-01-18 15:59:19.917 2007-02-02 14:39:44.293 604 6258815 6226041 53 2006-10-18 08:21:22.650 2008-08-20 10:54:03.647 22 6258816 6226042 8 2008-05-08 11:40:40.903 2008-05-12 12:47:23.727 3637963 6258817 6226043 121 2008-01-14 13:21:45.133 2008-08-20 10:55:00.120 3113115 768 765 11 2006-10-18 08:21:22.650 2007-01-25 13:45:58.067 22 6258813 6226039 52 2006-10-18 08:21:22.650 2008-05-08 11:41:32.983 22 6258814 6226040 120 2008-01-14 13:21:45.133 2008-05-12 12:55:13.723 3113115 10458053 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 772 769 2 2007-02-05 14:31:26.453 2007-02-05 14:32:16.423 770 10458052 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 771 768 1 2007-02-05 14:31:26.453 2007-02-05 14:31:26.453 770 6258824 6226048 122 2008-01-14 13:21:45.133 2008-08-20 10:55:39.373 3113115 10458055 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 774 771 4 2007-02-05 14:31:26.453 2007-02-05 14:52:04.317 770 6258825 6226049 123 2008-01-14 13:21:45.133 2008-08-20 12:37:15.103 3113115 10458054 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 773 770 3 2007-02-05 14:31:26.453 2007-02-05 14:32:40.373 770 10458057 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 776 773 6 2007-02-05 14:31:26.453 2007-02-05 14:58:22.830 770 10458056 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 6258820 6226045 29 2007-03-12 11:17:25.610 2007-07-16 16:12:05.077 163852 775 772 5 2007-02-05 14:31:26.453 2007-02-05 14:56:29.077 770 6258821 6226046 30 2007-03-12 11:17:25.610 2008-08-20 11:04:02.023 163852 778 775 8 2007-02-05 14:31:26.453 2007-02-05 15:06:59.730 770 10458058 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 777 774 7 2007-02-05 14:31:26.453 2007-02-05 14:59:37.067 770 10458044 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458045 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458046 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458047 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458048 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458049 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 2326552 2163017 2007-12-06 13:32:20.733 2007-12-06 13:32:20.733 2573 1 2326549 2326551 22 2007-12-07 15:09:47.457 2007-12-07 15:09:47.457 214528 1 10458050 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 2326550 22 2007-12-07 15:09:19.750 2007-12-07 15:09:19.750 785408 1 10458051 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458036 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 8060966 8093731 18 2007-12-05 08:57:43.203 2008-08-21 18:00:12.837 2163017 2326549 2163017 2007-12-06 13:32:20.733 2008-12-11 10:58:13.140 2933 3 10458037 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458038 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458039 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458040 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 10458041 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 9372010 9404758 25 2007-12-05 08:57:43.203 2009-01-26 15:30:55.700 2163017 10458042 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 8060968 8093733 19 2007-12-05 08:57:43.203 2008-12-11 10:39:11.610 2163017 10458043 22 2009-08-06 13:11:26.007 2009-08-06 13:11:26.007 798 795 14 2007-02-05 15:44:32.787 2007-02-05 16:42:49.903 780 3342837 3113176 2008-01-16 13:50:41.647 2008-01-16 13:50:41.647 797 794 13 2007-02-05 15:44:32.787 2007-02-05 16:28:02.837 780 3342836 3113176 2008-01-16 13:50:41.647 2008-01-16 13:50:41.647 796 793 12 2007-02-05 15:44:32.787 2007-02-05 16:27:30.050 780 795 792 11 2007-02-05 15:44:32.787 2007-02-05 16:26:30.047 780 3342838 3113176 2008-01-16 13:50:41.647 2008-01-16 13:50:41.647 802 799 17 2007-02-05 15:44:32.787 2007-02-05 16:51:59.593 780 6258845 6226069 23 2007-06-07 15:42:27.210 2008-04-28 12:36:59.430 1179679 6258846 6226070 15 2008-01-17 15:30:30.480 2008-05-08 11:53:20.450 3113240 800 797 16 2007-02-05 15:44:32.787 2007-02-05 16:44:57.407 780 799 796 15 2007-02-05 15:44:32.787 2007-02-05 16:43:53.627 780 806 803 20 2007-02-05 15:44:32.787 2007-02-06 11:46:54.770 780 6258857 6226080 126 2008-01-14 13:21:45.133 2008-08-20 13:26:36.727 3113115 6258858 6226081 6 2008-05-12 12:14:25.300 2008-05-12 12:50:10.797 3638049 805 802 19 2007-02-05 15:44:32.787 2007-02-06 11:46:29.587 780 804 801 18 2007-02-05 15:44:32.787 2007-02-06 10:57:20.703 780 6258855 6226078 11 2008-05-08 11:40:40.903 2008-08-20 13:26:36.747 3637963 803 800 3 2007-02-05 16:00:22.540 2007-02-05 16:17:07.830 789 3342849 698 2008-01-16 17:09:08.503 2008-01-16 17:09:08.503 6258853 6226076 4 2008-08-20 12:41:51.660 2008-08-20 13:12:22.823 6258828 809 806 23 2007-02-05 15:44:32.787 2007-02-06 12:06:04.913 780 6258854 6226077 10 2008-05-08 11:40:40.903 2008-08-20 13:12:22.827 3637963 808 805 22 2007-02-05 15:44:32.787 2007-02-06 12:05:24.710 780 6258851 6226074 125 2008-01-14 13:21:45.133 2008-08-20 13:12:22.807 3113115 6258852 6226075 56 2006-10-18 08:21:22.650 2008-08-20 13:12:22.817 22 3342850 698 2008-01-16 17:09:08.507 2008-01-16 17:09:08.507 807 804 21 2007-02-05 15:44:32.787 2007-02-06 11:51:15.580 780 6258834 6226058 55 2006-10-18 08:21:22.650 2008-08-20 12:39:51.437 22 781 778 1 2007-02-05 15:44:32.787 2007-02-05 15:44:32.787 780 782 779 2 2007-02-05 15:44:32.787 2007-02-05 15:45:27.757 780 6258833 6226057 124 2008-01-14 13:21:45.133 2008-08-20 12:37:26.953 3113115 6258832 6226056 2 2008-08-20 12:41:51.660 2008-08-20 12:49:55.587 6258828 779 776 9 2007-02-05 14:31:26.453 2007-02-05 15:07:50.533 770 3342856 917532 2008-01-17 11:47:01.423 2008-01-17 11:47:01.423 6258830 6226054 1 2008-08-20 12:41:51.660 2008-08-20 12:41:51.660 6258828 785 782 5 2007-02-05 15:44:32.787 2007-02-05 15:56:00.250 780 3342857 917532 2008-01-17 11:47:01.423 2008-01-17 11:47:01.423 786 783 6 2007-02-05 15:44:32.787 2007-02-05 15:56:19.903 780 783 780 3 2007-02-05 15:44:32.787 2007-02-05 15:49:23.990 780 6258827 6226051 54 2006-10-18 08:21:22.650 2008-08-20 10:55:00.143 22 784 781 4 2007-02-05 15:44:32.787 2007-02-05 15:53:20.230 780 790 787 1 2007-02-05 16:00:22.540 2007-02-05 16:00:22.540 789 6258841 6226065 8 2008-05-08 11:37:22.423 2008-05-08 14:00:05.337 3637958 787 784 7 2007-02-05 15:44:32.787 2007-02-05 15:56:40.073 780 788 785 10 2007-02-05 14:31:26.453 2007-02-05 15:32:41.443 770 793 790 9 2007-02-05 15:44:32.787 2007-02-05 16:24:49.923 780 794 791 10 2007-02-05 15:44:32.787 2007-02-05 16:25:35.307 780 791 788 2 2007-02-05 16:00:22.540 2007-02-05 16:16:50.013 789 6258836 6226060 9 2008-05-08 11:40:40.903 2008-08-20 10:55:00.150 3637963 6258835 6226059 3 2008-08-20 12:41:51.660 2008-08-20 13:11:49.127 6258828 792 789 8 2007-02-05 15:44:32.787 2007-02-05 15:59:01.407 780 6258876 6226099 57 2006-10-18 08:21:22.650 2008-08-20 13:26:36.733 22 6258878 6226101 58 2006-10-18 08:21:22.650 2008-08-20 14:00:29.840 22 6258880 6226103 59 2006-10-18 08:21:22.650 2008-08-20 14:03:32.100 22 6258882 6226105 60 2006-10-18 08:21:22.650 2008-08-20 14:04:38.457 22 6258883 6226106 61 2006-10-18 08:21:22.650 2008-08-20 14:07:36.433 22 6258884 6226107 62 2006-10-18 08:21:22.650 2008-08-20 14:07:57.767 22 557069 163852 2007-04-16 16:10:30.533 2007-05-18 17:03:28.563 51739 4 6258888 6226111 5 2008-08-20 12:41:51.660 2008-08-20 13:26:36.740 6258828 16876504 3113115 2011-05-11 14:57:22.067 2011-05-11 14:57:22.067 16876505 3113115 2011-05-11 14:57:22.067 2011-05-11 14:57:22.067 557075 163852 2007-04-16 16:10:30.533 2007-04-18 11:57:01.010 53653 2 557069 6258862 6226085 127 2008-01-14 13:21:45.133 2008-08-20 13:27:25.710 3113115 557074 163852 2007-04-16 16:10:30.533 2007-04-16 16:10:30.533 49636 1 557069 6258861 6226084 9 2008-05-08 11:37:22.423 2008-08-20 13:15:21.437 3637958 8061022 8093785 12 2008-01-11 16:50:35.080 2008-12-15 15:44:55.057 3113097 16876500 3113115 2011-05-11 14:57:22.067 2011-05-11 14:57:22.067 6258864 6226087 128 2008-01-14 13:21:45.133 2008-08-20 13:43:56.243 3113115 8061021 8093784 11 2008-01-11 16:50:35.080 2008-12-15 15:43:59.353 3113097 16876501 3113115 2011-05-11 14:57:22.067 2011-05-11 14:57:22.067 8061020 8093783 10 2008-01-11 16:50:35.080 2008-08-21 18:00:12.880 3113097 16876502 3113115 2011-05-11 14:57:22.067 2011-05-11 14:57:22.067 6258866 6226089 129 2008-01-14 13:21:45.133 2008-08-20 13:45:18.307 3113115 16876503 3113115 2011-05-11 14:57:22.067 2011-05-11 14:57:22.067 24118126 6258944 2013-12-09 12:22:02.360 2013-12-09 12:22:02.360 6258868 6226091 130 2008-01-14 13:21:45.133 2008-08-20 13:46:28.117 3113115 24118127 6258944 2013-12-09 12:22:02.360 2013-12-09 12:22:02.360 8061033 8093795 20 2007-12-05 08:57:43.203 2008-12-11 10:40:26.297 2163017 6258870 6226093 131 2008-01-14 13:21:45.133 2008-08-20 13:48:55.677 3113115 24118125 6258944 2013-12-09 12:22:02.360 2013-12-09 12:22:02.360 8061031 8093793 15 2008-05-08 11:37:22.423 2008-12-17 12:58:38.580 3637958 8061030 8093792 14 2008-05-08 11:37:22.423 2008-12-17 12:50:41.970 3637958 6258872 6226095 132 2008-01-14 13:21:45.133 2008-08-20 13:50:43.883 3113115 3670614 {code} to {code:xml}{code} #* Change {code:xml} KeepAlive Label org.mbari.eits.DataTurbine ProgramArguments /Applications/RBNB/bin/dataturbine-launchd.sh RunAtLoad EnvironmentVariables CATALINA_HOME /Applications/RBNB/apache-tomcat-5.5.12 JAVA_HOME /System/Library/Frameworks/JavaVM.framework/Home {code} #* It's easiest to set this up using [Lingon|http://lingon.sourceforge.net/]]]> 3637864 8061028 8093790 13 2008-05-08 11:37:22.423 2008-12-17 12:49:04.733 3637958 6258873 6226096 7 2008-05-12 12:14:25.300 2008-08-20 13:27:25.720 3638049 8061027 8093789 12 2008-05-08 11:37:22.423 2008-08-21 17:58:17.680 3637958 10458035 22 2009-08-06 13:11:26.003 2009-08-06 13:11:26.003 10458034 22 2009-08-06 13:11:26.003 2009-08-06 13:11:26.003 10458033 22 2009-08-06 13:11:26.003 2009-08-06 13:11:26.003 10458032 22 2009-08-06 13:11:26.003 2009-08-06 13:11:26.003 6979600   \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | h2. # Login into EITS using a Remote Desktop Connection, or equivalent.  Use the user name:  erika,  and ask Erika for the password. # Once logged in, click the cygwin icon (click to enlarge) !EITSChangeAVEDOptions1.png|thumbnail! # In the cygwin window set the xemacs editor as your default editor and edit the crontab file with the following: {code} $ export EDITOR='xemacs' $ crontab -e {code} This will open the xemacs editor with the contents of the crontab file.  # Change the options designated by the environment variable MBARIVISION_OPTIONS as this variable stores all the AVED processing options. (click to enlarge) !EITSChangeAVEDOptions2.png|thumbnail,width=200,height=162! # After changes are made, save the changes and exit xemacs to implement the changes and you're done \!\! (click to enlarge) !EITSChangeAVEDOptions3.png|thumbnail! h3. How to change the video mask If changes to the video mask are required, simply replace the videomask.jpg file in the \~/workflow directory with the one to use in the workflow. ]]> 6946832 16876499 3113115 2011-05-11 14:57:22.067 2011-05-11 14:57:22.067 983042 780 2007-04-30 15:50:36.473 2007-04-30 15:50:36.473 16876498 3113115 2011-05-11 14:57:22.067 2011-05-11 14:57:22.067 6258894 6226116 64 2006-10-18 08:21:22.650 2008-08-20 14:20:58.303 22 6258893 6226115 7 2008-08-20 12:41:51.660 2008-08-20 14:20:58.323 6258828 6258892 6226114 6 2008-08-20 12:41:51.660 2008-08-20 14:18:18.450 6258828 6258891 6226113 63 2006-10-18 08:21:22.650 2008-08-20 14:08:56.280 22 4825 937 2007-02-21 14:44:29.380 2007-02-21 14:44:29.380 4824 937 2007-02-21 14:44:29.380 2007-02-21 14:44:29.380 8061074 8093837 17 2008-05-08 11:37:22.423 2008-12-22 10:41:16.633 3637958 8061073 8093836 13 2008-01-11 16:50:35.080 2008-12-15 15:45:26.377 3113097 8061071 8093834 16 2008-05-08 11:37:22.423 2008-12-17 13:04:59.927 3637958 936 933 12 2006-10-18 08:21:22.650 2007-02-05 14:30:27.317 22 3670702 Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg! # Now start the rsyncd service: {noformat} net start rsyncd {noformat}]]> 3637952 3670705 Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service for user *erika* {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D -u erika {noformat} You will be prompted for your password. Change this to the same password you use to login to EITS. This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. {noformat} chmod a+rwx /var/log/cron.log {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running.]]> 3637956 3670706 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 3637958 918 915 23 2007-01-18 15:59:19.917 2007-02-20 11:43:34.853 604 917 914 22 2007-01-18 15:59:19.917 2007-02-20 09:23:18.930 604 3670710 3637963 916 913 21 2007-01-18 15:59:19.917 2007-02-19 08:08:43.333 604 915 912 20 2007-01-18 15:59:19.917 2007-02-05 09:28:07.097 604 10354897 10387661 16 2007-03-01 08:35:46.057 2009-02-09 09:32:09.353 1023 8455429 2163016 2009-01-14 14:50:16.643 2009-01-14 14:50:16.643 8455428 2163016 2009-01-14 14:50:16.643 2009-01-14 14:50:16.643 8455431 8356190 2009-01-14 14:53:22.140 2009-01-14 14:53:22.140 3178759 3113242 8455430 2163016 2009-01-14 14:50:16.643 2009-01-14 14:50:16.643 3178758 3113240 8455432 8356190 2009-01-14 14:53:22.140 2009-01-14 14:53:22.140 8388941 8356190 1048586 22 2007-05-22 12:21:46.890 2007-05-22 12:21:46.890 58137 1 944 941 5 2007-02-21 14:32:30.070 2007-02-21 14:41:53.923 938 1048587 22 2007-05-22 12:22:12.720 2007-05-22 12:22:12.720 41472 1 943 940 4 2007-02-21 14:32:30.070 2007-02-21 14:40:33.117 938 945 942 1 2007-02-21 14:32:11.103 2007-02-21 14:32:11.103 937 940 937 2 2007-02-21 14:32:30.070 2007-02-21 14:33:15.217 938 939 936 1 2007-02-21 14:32:30.070 2007-02-21 14:32:30.070 938 941 938 3 2007-02-21 14:32:30.070 2007-02-21 14:37:38.437 938 1048585 163852 2007-04-16 16:10:30.533 2007-04-18 11:58:27.890 54867 3 557069 991 988 24 2007-01-18 15:59:19.917 2007-02-20 12:05:43.883 604 992 989 25 2007-01-18 15:59:19.917 2007-02-23 10:38:36.923 604 9372011 9404759 26 2007-12-05 08:57:43.203 2009-03-03 13:34:50.640 2163017 12779524 6258944 2010-05-14 13:35:29.400 2010-05-14 13:35:29.400 193260 1 12779523 6258944 2010-05-14 13:33:04.903 2010-05-14 13:33:04.903 4114 1 12779522 6258944 2010-05-14 13:31:50.537 2010-05-14 13:31:50.537 106747 1 13140049 13172815 10 2008-08-21 18:01:47.250 2010-06-03 23:34:02.840 6258944 976 973 13 2006-10-18 08:21:22.650 2007-02-21 14:31:48.877 22 13140047 13172813 9 2008-08-21 18:01:47.250 2010-05-14 13:35:44.873 6258944 8913074 8945835 24 2007-12-05 08:57:43.203 2009-01-07 15:02:20.107 2163017 8355901 8388666 21 2007-12-05 08:57:43.203 2008-12-18 09:49:41.980 2163017 8355905 8388670 23 2007-12-05 08:57:43.203 2009-01-07 15:01:59.080 2163017 8355904 8388669 22 2007-12-05 08:57:43.203 2009-01-07 14:56:01.647 2163017 9438608 2163017 2009-03-03 13:35:27.687 2009-03-03 13:35:27.687 9438604 2163017 2009-03-03 13:35:27.683 2009-03-03 13:35:27.683 9438605 2163017 2009-03-03 13:35:27.683 2009-03-03 13:35:27.683 9438606 2163017 2009-03-03 13:35:27.683 2009-03-03 13:35:27.683 579 581 9438607 2163017 2009-03-03 13:35:27.683 2009-03-03 13:35:27.683 9438602 2163017 2009-03-03 13:35:27.683 2009-03-03 13:35:27.683 9438603 2163017 2009-03-03 13:35:27.683 2009-03-03 13:35:27.683 602 The EITS video page{color} {color:#000099}[EITS Video]{color}{color:#000099} has been updated.  Don't know the specific question this is referring to from the diagram, if you could post a more specific question that would be helpful.{color} {panel} {panel} *Q. Lee needs to tell us how video and ancillary dat{*}*[~dcline]*{*}a will be delivered to shore.* {color:#000099}[~dcline]{color} {color:#000099}\-> I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} [~erikar] The above quote is correct.  Lee will need an API from you to make calls and put data into the VARS system. [~brian] _From Feb 23rd 2007 conference call:_ Lee will deliver Video files ans CSV text anxillary data to the RAID drive on shore. We will write up a loader to stuff the anxillary data into EITS database tables. {panel} {panel} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. [~erikar] We still plan to keep all the original data from the mirrored RAID, as you mentioned.  It is my understanding that we will also need to have VARS and AVED loaded onto a computer here in Florida if we want to edit any AVED events; however, the computer in Florida will not require the same cluster arrangement as the AVED processing computer at MBARI.  Is this correct?  Our group will pay for the computer in Florida. {color:#0000cc}Yes, you will not need a cluster. The project has allocated time to setup a workstation for deployment at ORCA which will have what you need to edit the events.  We also have travel money to come to Florida to help setup this computer and for any needed training. I imagine this computer will be a mirrored setup to what we have on the shore-side system here at MBARI (AVED, VARS, etc.), but we still need to work out those details.{color} {panel} {panel} *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. [~brian] _From Feb 23rd 2007 conference call:_ The current plan is to host a _replicated_ database both at MBARI and ORCA. MySQL 5.0 does support replication but we'll need to test this. [~brian] From [2007-04-11]. Setting up a server for integration testing. _mbari649_ (Mac OS X 10.4) is being setup with MySQL 5, Apache, and Darwin Streaming Server. Also setting up automount of RAID on nanomia. {panel} {panel} *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. [~erikar] Lee had a suggestion.  In the beginning we store 3 different video archives 1) all raw EITS data 2) AVED processed data and 3) edited AVED data.  VARS would have three fields, one for each archive.  The pointers in VARS would specify a directory path to the correct archive.  I can explain this better over the phone if you want to call me 772-321-5879. [~brian] _From Feb 23rd 2007 conference call:_ We will run though a demonstration of the entire data flow before we decide how to manage reprocessing. {panel} {panel} *Q. Where will the EITS computers live?* Initially at MBARI  {panel} {panel} *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} [~erikar] Lee will provide you with a time-code from EITS [~brian] _From Feb 23rd 2007 conference call:_ -Lee is going to investigate using a QuickTime container with MPEG-4 encoding. We'll send him sample code of how to write a TimeCode track.- TimeCode will be written as GMT/UTC time. [~brian] The current plan is for us to add the TimeCode track as part of our workflow. We have a script for doing this. {panel} {panel} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote}{info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. {panel} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 604 597 599 8913023 8945786 1 2009-01-23 10:33:06.733 2009-01-23 10:33:06.733 8913021 8913026 8945789 2 2009-01-23 10:33:06.733 2009-01-23 10:52:38.307 8913021 24051900 24084667 11 2008-08-21 18:01:47.250 2010-06-03 23:37:58.723 6258944 8913031 8945794 3 2009-01-23 10:33:06.733 2009-01-23 11:01:31.160 8913021 8913033 8945796 4 2009-01-23 10:33:06.733 2009-01-23 11:09:07.680 8913021 8913042 8945805 9 2009-01-23 10:33:06.733 2009-01-23 11:38:27.140 8913021 8355881 8388648 18 2008-05-08 11:37:22.423 2008-12-22 14:41:56.343 3637958 8913039 8945802 7 2009-01-23 10:33:06.733 2009-01-23 11:35:00.893 8913021 8913040 8945803 8 2009-01-23 10:33:06.733 2009-01-23 11:37:37.690 8913021 8913037 8945800 6 2009-01-23 10:33:06.733 2009-01-23 11:33:23.540 8913021 8913035 8945798 5 2009-01-23 10:33:06.733 2009-01-23 11:27:06.667 8913021 8913049 8945812 13 2009-01-23 10:33:06.733 2009-01-23 11:43:58.243 8913021 8913050 8945813 14 2009-01-23 10:33:06.733 2009-01-23 11:45:07.783 8913021 8913047 8945810 12 2009-01-23 10:33:06.733 2009-01-23 11:42:48.610 8913021 8913045 8945808 11 2009-01-23 10:33:06.733 2009-01-23 11:41:39.800 8913021 8355867 8388634 11 2008-02-13 10:24:08.407 2009-01-05 15:16:45.583 3113551 8355869 8388636 2 2008-05-08 11:33:35.547 2008-05-08 12:09:42.607 3637952 8355870 8388637 3 2008-05-08 11:36:29.567 2008-05-08 17:05:31.587 3637956 8913044 8945807 10 2009-01-23 10:33:06.733 2009-01-23 11:40:22.567 8913021 7045143 6258828 2008-10-23 10:22:07.473 2008-10-23 10:22:07.473 8913057 8945820 134 2008-01-14 13:21:45.133 2008-10-06 11:19:37.673 3113115 8913056 8945819 17 2009-01-23 10:33:06.733 2009-01-23 11:48:51.543 8913021 8355866 8388633 10 2008-02-13 10:24:08.407 2008-02-20 16:21:38.853 3113551 7045146 6258828 2008-10-23 10:22:07.473 2008-10-23 10:22:07.473 8913054 8945817 16 2009-01-23 10:33:06.733 2009-01-23 11:46:40.953 8913021 7045147 6258828 2008-10-23 10:22:07.473 2008-10-23 10:22:07.473 753665 1 937 2007-03-23 10:50:15.027 2007-03-23 10:50:15.027 7045144 6258828 2008-10-23 10:22:07.473 2008-10-23 10:22:07.473 8913052 8945815 15 2009-01-23 10:33:06.733 2009-01-23 11:45:50.697 8913021 7045145 6258828 2008-10-23 10:22:07.473 2008-10-23 10:22:07.473 753667 1 22 2007-03-23 10:50:15.080 2007-03-23 10:50:15.080 9372391 9405123 6 2009-03-11 16:58:27.840 2009-03-26 09:35:35.870 9372210 753666 1 937 2007-03-23 10:50:15.073 2007-03-23 10:50:15.073 753668 4 946 2007-03-23 10:50:15.083 2007-03-23 10:50:15.083 9372388 9405120 4 2009-03-11 16:58:27.840 2009-03-11 17:28:08.650 9372210 753671 2 1023 2007-03-30 12:55:15.043 2007-04-03 15:06:15.057 9372390 9405122 5 2009-03-11 16:58:27.840 2009-03-26 09:31:24.147 9372210 753673 1 581 2007-04-02 14:36:15.067 2007-04-02 14:36:15.067 11864106 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864107 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864104 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864105 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864102 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864103 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 6325025 3113240 2008-08-21 18:07:40.207 2008-08-21 18:07:40.207 11864100 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864101 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 6325024 3113240 2008-08-21 18:07:40.207 2008-08-21 18:07:40.207 6226500 6259292 1540126 938 2007-07-16 17:12:27.963 2007-07-16 17:12:27.963 102954 1 767 770 8946091 8913345 766 769 11864099 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864098 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864097 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864096 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 3179050 3113551 11864095 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864094 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 11864093 163852 2010-05-06 15:48:18.363 2010-05-06 15:48:18.363 19234835 20 22 2012-11-07 14:05:40.710 2012-11-07 14:05:40.710 8913001 8945764 32 2007-03-12 11:17:25.610 2009-01-20 16:32:41.870 163852 1540124 938 2007-07-16 16:42:26.087 2007-07-16 16:54:10.287 122853 2 1540125 938 2007-07-16 16:42:26.087 2007-07-16 16:42:26.087 122976 1 1540124 1540123 163852 2007-07-16 16:11:41.293 2007-07-16 16:11:41.293 71055 1 1015809 1 163852 2007-05-02 15:40:15.027 2007-05-02 15:40:15.027 9372218 9404955 3 2009-03-11 16:58:27.840 2009-03-11 17:01:11.873 9372210 9372215 9404952 2 2009-03-11 16:58:27.840 2009-03-11 17:00:53.697 9372210 9372214 9404951 1 2009-03-11 16:58:27.840 2009-03-11 16:58:27.840 9372210 8355978 8388739 6 2007-04-16 16:20:48.017 2009-01-08 15:06:13.737 589949 8355977 8388738 5 2007-04-16 16:20:48.017 2008-02-14 11:33:01.320 589949 9372221 9404958 85 2006-10-18 08:21:22.650 2009-02-24 16:08:22.937 22 695 698 9372222 9404959 86 2006-10-18 08:21:22.650 2009-03-11 17:30:46.457 22 656 659 8912910 8945678 31 2007-03-12 11:17:25.610 2008-08-20 11:04:35.047 163852 11599875 11567106 6946832 2010-02-04 12:55:00.217 2010-02-04 12:55:00.217 9404948 9372210 8355980 8388741 7 2007-04-16 16:20:48.017 2009-01-08 15:07:40.733 589949 8913342 8946090 15 2007-03-01 08:35:46.057 2007-12-05 08:41:54.690 1023 8913341 8946089 82 2006-10-18 08:21:22.650 2008-11-12 17:11:57.367 22 8913346 8946092 1 2009-02-09 09:48:38.713 2009-02-09 09:48:38.713 8913345 8913349 8946095 4 2009-02-09 09:48:38.713 2009-02-09 10:03:33.363 8913345 8913348 8946094 3 2009-02-09 09:48:38.713 2009-02-09 10:00:50.060 8913345 8913347 8946093 2 2009-02-09 09:48:38.713 2009-02-09 09:49:02.153 8913345 8913352 8946098 5 2009-02-09 09:48:38.713 2009-02-09 10:29:18.263 8913345 19300575 5 2012-06-18 17:12:51.717 2012-06-18 17:12:51.717 6259296 6226504 133 2008-01-14 13:21:45.133 2008-08-20 13:52:29.893 3113115 6259295 6226503 10 2008-08-20 12:41:51.660 2008-09-23 11:48:45.703 6258828 6259294 6226502 1 2008-10-06 11:09:17.437 2008-10-06 11:09:17.437 6259292 6259300 6226507 69 2006-10-18 08:21:22.650 2008-10-07 12:46:00.593 22 6259299 6226506 68 2006-10-18 08:21:22.650 2008-08-21 18:09:19.493 22 2031622 589949 2007-09-12 13:56:37.493 2007-09-12 13:56:37.493 41472 1 10355315 10388047 23 2008-01-17 15:30:48.920 2009-06-24 11:10:14.277 3113242 8913361 8946107 6 2009-02-09 09:48:38.713 2009-02-09 14:07:08.637 8913345 8356188 8388939 3 2007-12-05 08:55:31.777 2008-01-15 11:38:13.930 2163016 6259213 6226424 9 2008-08-20 12:41:51.660 2008-09-23 11:48:32.787 6258828 6259212 6226423 8 2008-08-20 12:41:51.660 2008-08-20 14:21:16.647 6258828 2163082 2195846 2 2007-04-16 16:20:48.017 2007-09-12 13:58:07.470 589949 2163053 2195817 22 2006-10-18 08:21:22.650 2007-12-05 08:55:02.000 22 2163054 2195818 23 2006-10-18 08:21:22.650 2007-12-07 15:08:32.180 22 2163057 2195821 59 2007-02-21 14:32:30.070 2007-07-16 17:13:50.643 938 2163058 2195822 26 2006-10-18 08:21:22.650 2007-12-07 15:16:12.770 22 3259 770 2007-02-05 16:00:04.167 2007-02-05 16:00:04.167 2163055 2195819 24 2006-10-18 08:21:22.650 2007-12-07 15:12:40.833 22 8945784 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding  !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* # Launch a cygwin shell by clicking on the Desktop icon   !WMESSetup3.png! # Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv --install eitsstreaming --path /cygdrive/c/WINDOWS/system32/cscript.exe --args "\"C:\Program Files\Windows Media Components\Encoder\WMCmd.vbs\" -wme \"c:\Documents and Settings\erika\My Documents\eits_video_stream.wme\"" -u erika {noformat} # The service should now show up in the services panel as *eitstreaming*, and from there you can start/stop it.  !WMESSetup4.png!]]> 8913021 3258 770 2007-02-05 16:00:04.167 2007-02-05 16:00:04.167 2163056 2195820 25 2006-10-18 08:21:22.650 2007-12-07 15:14:15.250 22 2163061 2195825 1 2007-12-07 15:37:50.557 2007-12-07 15:37:50.557 2163060 2163062 2195826 2 2007-12-07 15:37:50.557 2007-12-07 15:38:36.593 2163060 2163059 2195823 27 2006-10-18 08:21:22.650 2007-12-07 15:17:53.497 22 2163065 2195829 4 2007-12-07 15:37:50.557 2007-12-07 15:57:02.937 2163060 2163066 2195830 28 2006-10-18 08:21:22.650 2007-12-07 15:19:45.797 22 2163063 2195827 3 2007-12-07 15:37:50.557 2007-12-07 15:44:23.850 2163060 2163064 2195828 10 2007-04-11 09:50:01.490 2007-12-06 15:09:42.437 589928 777 toConcept -> LinkValue. Currently considered associations are: * *"identity-reference | self | "* * *"saliency | self | "* * "start-timecode | self | " h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| ]]> 780 294923 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. -For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.- This has been installed as a Condor job on the computer somniosus. See details on Condor installation [here|EITS:Somniosus] for more information.]]> 163852 16777382 16810144 137 2008-01-14 13:21:45.133 2010-03-05 10:13:40.230 3113115 786 frameRate field.{color}{note} !AVED Event Classes.jpg! h2. XML Sample {code} {code}]]> 789 133 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 2163018 2195782 1 2007-12-05 08:57:43.203 2007-12-05 08:57:43.203 2163017 134 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 9798562 9831306 5 2009-05-15 13:14:57.057 2009-05-15 14:01:21.000 9798548 135 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 19039294 19072038 22 2009-05-15 13:14:57.057 2010-08-04 16:43:09.223 9798548 2163015 2195779 21 2006-10-18 08:21:22.650 2007-05-22 12:26:06.680 22 136 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 9798560 9831304 4 2009-05-15 13:14:57.057 2009-05-15 13:35:24.837 9798548 137 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 2163014 2195778 14 2007-03-01 08:35:46.057 2007-04-18 05:10:14.637 1023 138 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 9798558 9831302 3 2009-05-15 13:14:57.057 2009-05-15 13:32:49.617 9798548 1020 qt4j qt4j [0.10,) compile ... ... VARS VARS Repository http://vars.sourceforge.net/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QTX4J in your [ant build script|SPEPRJ:Maven At MBARI] or download the jars directly from [here|http://vars.sourceforge.net/maven2/org/mbari/qtx4j/]. If you do download _QTX4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://vars.sourceforge.net/maven2/imagej/imagej/1.37//imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[MBARIX4J|http://vars.sourceforge.net/maven2/org/mbari/mbarix4j/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr4j|http://vars.sourceforge.net/maven2/org/mbari/vcr4j/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana.shore.mbari.org/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana.shore.mbari.org/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] h2. Testing Resources AVED processed data that is used for testing is currently hosted on Nanomia. Here's a few useful links: * EITS test data processed by Ishbel: [http://nanomia.shore.mbari.org/EITS_testing] * Test data with longer clips: [http://nanomia.shore.mbari.org/EITS_testing/RESULTS] * RAID storage for [~brian] mapped to _\\nanomia\RAID\brian_: [http://nanomia.shore.mbari.org/brian] h2. VARS mini [VARS Mini] ]]> 1023 139 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 140 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 9798556 9831300 2 2009-05-15 13:14:57.057 2009-05-15 13:16:30.200 9798548 141 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 142 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 143 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 9798567 9831311 13 2008-01-17 15:30:48.920 2009-05-15 14:18:26.890 3113242 144 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 9798568 9831312 7 2009-05-15 13:14:57.057 2009-05-15 14:18:09.273 9798548 145 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 9798565 9831309 6 2009-05-15 13:14:57.057 2009-05-15 14:05:47.847 9798548 146 5 2006-10-18 08:21:22.650 2006-10-18 08:21:22.650 9798566 9831310 12 2008-01-17 15:30:48.920 2009-05-15 14:16:34.073 3113242 9798564 9831308 11 2008-01-17 15:30:48.920 2009-05-15 13:15:11.433 3113242 9798545 9831290 9 2008-01-17 15:30:48.920 2009-05-14 17:13:03.397 3113242 9798541 9831287 8 2008-01-17 15:30:48.920 2008-08-21 18:08:12.707 3113242 9798539 9831285 90 2006-10-18 08:21:22.650 2009-04-03 11:16:53.473 22 9798553 9831297 91 2006-10-18 08:21:22.650 2009-05-14 16:14:48.553 22 9798551 9831295 1 2009-05-15 13:14:57.057 2009-05-15 13:14:57.057 9798548 9798550 9831294 26 2007-06-07 15:42:27.210 2008-08-21 18:08:12.673 1179679 6259422 6226623 8 2008-05-12 12:14:25.300 2008-08-20 13:52:29.903 3638049 9798549 9831293 10 2008-01-17 15:30:48.920 2009-05-15 13:13:02.757 3113242 2163046 2195810 9 2007-04-11 09:50:01.490 2007-06-22 15:37:42.127 589928 2163035 2195799 10 2007-12-05 08:57:43.203 2007-12-06 13:41:23.650 2163017 2163036 2195800 11 2007-12-05 08:57:43.203 2007-12-06 13:41:54.723 2163017 2163037 2195801 12 2007-12-05 08:57:43.203 2007-12-06 13:42:28.347 2163017 2163032 2195796 7 2007-12-05 08:57:43.203 2007-12-06 13:37:33.540 2163017 2163031 2195795 6 2007-12-05 08:57:43.203 2007-12-06 13:35:54.063 2163017 2163034 2195798 9 2007-12-05 08:57:43.203 2007-12-06 13:40:24.843 2163017 2163033 2195797 8 2007-12-05 08:57:43.203 2007-12-06 13:39:56.603 2163017 2163028 2195792 3 2007-12-05 08:57:43.203 2007-12-05 09:46:54.347 2163017 2163030 2195794 5 2007-12-05 08:57:43.203 2007-12-06 13:31:03.747 2163017 2163029 2195793 4 2007-12-05 08:57:43.203 2007-12-06 13:26:34.760 2163017 2163019 2195783 2 2007-12-05 08:57:43.203 2007-12-05 08:59:31.850 2163017 6259348 6226551 76 2006-10-18 08:21:22.650 2008-10-13 12:11:46.850 22 2162953 2195717 6 2007-02-05 16:00:22.540 2007-05-23 16:38:50.100 789 6259346 6226549 75 2006-10-18 08:21:22.650 2008-10-13 12:11:19.783 22 6259345 6226548 74 2006-10-18 08:21:22.650 2008-10-09 13:22:07.933 22 943 946 9405227 9372496 934 937 935 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.    !EITS AVED Processing Activity Milestone1.jpg|thumbnail!\\ h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 938 8913194 8945951 18 2009-01-23 10:33:06.733 2009-01-23 11:49:55.097 8913021 6259310 6226513 70 2006-10-18 08:21:22.650 2008-10-07 12:53:00.400 22 6259312 6226515 71 2006-10-18 08:21:22.650 2008-10-07 14:07:57.887 22 6259314 6226517 72 2006-10-18 08:21:22.650 2008-10-07 14:20:32.203 22 9372507 9405238 5 2009-04-03 11:06:41.540 2009-04-03 11:16:18.700 9372496 9372508 9405239 6 2009-04-03 11:06:41.540 2009-04-03 11:16:53.493 9372496 9372506 9405237 89 2006-10-18 08:21:22.650 2009-04-03 11:00:01.333 22 9798572 9831316 15 2008-01-17 15:30:48.920 2009-05-15 14:37:03.177 3113242 2162964 2195728 20 2007-05-10 15:13:11.397 2007-11-27 15:56:32.123 917532 6259332 6226535 12 2008-05-08 11:40:40.903 2008-08-20 13:27:02.960 3637963 9372505 9405236 4 2009-04-03 11:06:41.540 2009-04-03 11:15:21.580 9372496 9798571 9831315 14 2008-01-17 15:30:48.920 2009-05-15 14:20:26.273 3113242 2162963 2195727 19 2007-05-10 15:13:11.397 2007-07-03 16:27:19.980 917532 9798574 9831318 9 2009-05-15 13:14:57.057 2009-05-15 14:53:40.063 9798548 2162966 2195730 22 2007-05-10 15:13:11.397 2007-11-27 16:03:01.517 917532 9798573 9831317 8 2009-05-15 13:14:57.057 2009-05-15 14:21:47.843 9798548 9372503 9405234 3 2009-04-03 11:06:41.540 2009-04-03 11:14:15.187 9372496 2162965 2195729 21 2007-05-10 15:13:11.397 2007-11-27 16:02:43.007 917532 2162968 2195732 14 2007-06-07 15:42:27.210 2007-07-03 10:44:25.870 1179679 229382 938 2007-03-09 16:29:26.867 2007-03-09 16:29:26.867 49006 1 9798576 9831320 17 2008-01-17 15:30:48.920 2009-05-15 14:56:27.160 3113242 229383 938 2007-03-09 13:42:12.580 2007-03-09 15:46:44.953 58198 3 229379 9372501 9405232 2 2009-04-03 11:06:41.540 2009-04-03 11:09:26.540 9372496 9798575 9831319 16 2008-01-17 15:30:48.920 2009-05-15 14:53:23.027 3113242 2162967 2195731 23 2007-05-10 15:13:11.397 2007-11-27 16:11:49.550 917532 9798578 9831322 18 2008-01-17 15:30:48.920 2009-05-15 15:34:10.040 3113242 9798577 9831321 10 2009-05-15 13:14:57.057 2009-05-15 14:56:10.227 9798548 9372499 9405230 1 2009-04-03 11:06:41.540 2009-04-03 11:06:41.540 9372496 9798580 9831324 19 2008-01-17 15:30:48.920 2009-05-15 16:30:44.590 3113242 229379 938 2007-03-09 13:42:12.580 2007-03-09 16:32:01.453 60002 4 229380 938 2007-03-09 13:42:12.580 2007-03-09 13:42:12.580 27681 1 229379 229381 938 2007-03-09 13:42:12.580 2007-03-09 13:43:10.990 27681 2 229379 9798581 9831325 20 2008-01-17 15:30:48.920 2009-05-15 16:31:45.497 3113242 9372494 9405225 88 2006-10-18 08:21:22.650 2009-04-03 10:59:48.450 22 9798584 9831328 21 2008-01-17 15:30:48.920 2009-05-15 16:35:20.383 3113242 9372493 9405224 87 2006-10-18 08:21:22.650 2009-03-11 17:31:40.173 22 6259329 6226532 73 2006-10-18 08:21:22.650 2008-10-07 14:23:34.780 22 3113146 3178666 5 2008-01-15 11:41:47.420 2008-01-15 11:57:40.770 3113134 3113144 3178664 4 2008-01-15 11:41:47.420 2008-01-15 11:54:10.057 3113134 3113142 3178662 3 2008-01-15 11:41:47.420 2008-01-15 11:48:01.990 3113134 3113140 3178660 2 2008-01-15 11:41:47.420 2008-01-15 11:44:34.490 3113134 3113138 3178658 1 2008-01-15 11:41:47.420 2008-01-15 11:41:47.420 3113134 12484630 12550165 4 2008-08-21 18:01:47.250 2008-08-21 18:07:13.243 6258944 3113136 3178656 24 2007-05-10 15:13:11.397 2007-11-27 16:13:26.343 917532 12484634 12550169 7 2008-08-21 18:01:47.250 2010-05-14 12:18:24.847 6258944 3113131 3178652 2 2007-12-05 08:55:31.777 2008-01-14 12:55:01.610 2163016 12484631 12550166 5 2008-08-21 18:01:47.250 2010-05-14 12:13:06.873 6258944 3113132 3178653 4 2008-01-14 13:21:45.133 2008-01-14 13:28:45.243 3113115 12484632 12550167 6 2008-08-21 18:01:47.250 2010-05-14 12:13:49.563 6258944 3113161 3178681 4 2008-01-11 16:50:35.080 2008-01-16 10:53:32.477 3113097 3113160 3178680 3 2008-01-11 16:50:35.080 2008-01-11 16:52:43.357 3113097 12484636 12550171 8 2008-08-21 18:01:47.250 2010-05-14 12:47:20.250 6258944 9798658 9831397 12 2009-05-15 13:14:57.057 2009-05-21 16:58:14.410 9798548 9798656 9831395 11 2009-05-15 13:14:57.057 2009-05-15 15:34:28.847 9798548 3113175 3178694 7 2008-01-11 16:50:35.080 2008-01-16 11:27:10.147 3113097 12320769 22 2008-10-07 12:45:46.407 2008-10-13 12:12:36.960 367564 3 6291589 3113173 3178692 5 2008-01-11 16:50:35.080 2008-01-16 11:06:14.670 3113097 3113174 3178693 6 2008-01-11 16:50:35.080 2008-01-16 11:25:17.157 3113097 8454298 3637952 2009-01-05 15:20:37.093 2009-01-05 15:20:37.093 3113167 3178687 3 2008-01-14 09:38:57.487 2008-01-16 11:13:41.060 3113110 3113170 3178689 15 2007-04-11 09:50:01.490 2008-01-16 11:14:33.603 589928 3113163 3178683 1 2008-01-14 09:38:57.487 2008-01-14 09:38:57.487 3113110 3113165 3178685 2 2008-01-14 09:38:57.487 2008-01-16 11:08:28.730 3113110 3113166 3178686 14 2007-04-11 09:50:01.490 2008-01-14 09:39:22.533 589928 3113191 3178710 6 2008-01-14 13:21:45.133 2008-01-16 15:43:03.073 3113115 3113193 3178712 7 2008-01-14 13:21:45.133 2008-01-16 15:55:15.717 3113115 3113188 3178707 5 2008-01-16 11:28:39.897 2008-01-16 13:26:45.097 3113176 3113187 3178706 4 2008-01-16 11:28:39.897 2008-01-16 13:24:39.630 3113176 3113190 3178709 5 2008-01-14 13:21:45.133 2008-01-15 11:39:03.683 3113115 3113184 3178703 2 2008-01-16 11:28:39.897 2008-01-16 11:44:47.190 3113176 3113185 3178704 3 2008-01-16 11:28:39.897 2008-01-16 13:24:21.390 3113176 3113180 3178699 16 2007-06-07 15:42:27.210 2008-01-16 11:39:37.530 1179679 3113179 3178698 15 2007-06-07 15:42:27.210 2007-11-27 16:15:06.007 1179679 3113182 3178701 1 2008-01-16 11:28:39.897 2008-01-16 11:28:39.897 3113176 3113181 3178700 8 2008-01-11 16:50:35.080 2008-01-16 11:27:25.510 3113097 656340 589939 2007-04-12 11:07:39.137 2007-04-12 11:07:39.137 656341 589939 2007-04-12 11:07:39.137 2007-04-12 11:07:39.137 656342 589939 2007-04-12 11:07:39.137 2007-04-12 11:07:39.137 656343 589939 2007-04-12 11:07:39.137 2007-04-12 11:07:39.137 656344 589939 2007-04-12 11:07:39.137 2007-04-12 11:07:39.137 656345 589939 2007-04-12 11:07:39.137 2007-04-12 11:07:39.137 656346 589939 2007-04-12 11:07:39.137 2007-04-12 11:07:39.137 3113095 3178619 13 2007-12-05 08:57:43.203 2007-12-06 13:45:41.550 2163017 3113107 3178631 12 2007-04-11 09:50:01.490 2008-01-14 09:11:21.533 589928 3113111 3178634 13 2007-04-11 09:50:01.490 2008-01-14 09:13:31.460 589928 3113113 3178635 1 2007-12-05 08:55:31.777 2007-12-05 08:55:31.777 2163016 3113099 3178623 1 2008-01-11 16:50:35.080 2008-01-11 16:50:35.080 3113097 3113101 3178625 14 2007-12-05 08:57:43.203 2008-01-11 16:45:51.973 2163017 3113102 3178626 2 2008-01-11 16:50:35.080 2008-01-11 16:51:17.340 3113097 3113105 3178628 11 2007-04-11 09:50:01.490 2007-12-07 15:57:39.147 589928 656327 589930 2007-04-11 13:04:41.157 2007-04-11 13:04:41.157 656326 589930 2007-04-11 13:04:41.157 2007-04-11 13:04:41.157 8519690 589949 2009-01-08 15:06:37.410 2009-01-08 15:06:37.410 26585 1 656330 589930 2007-04-11 13:04:41.157 2007-04-11 13:04:41.157 656329 589930 2007-04-11 13:04:41.157 2007-04-11 13:04:41.157 656328 589930 2007-04-11 13:04:41.157 2007-04-11 13:04:41.157 11797302 11830046 33 2007-03-12 11:17:25.610 2009-01-22 13:24:52.483 163852 3113116 3178638 1 2008-01-14 13:21:45.133 2008-01-14 13:21:45.133 3113115 12222471 12255239 20 2008-05-08 11:37:22.423 2010-05-10 15:46:01.820 3637958 3113118 3178640 2 2008-01-14 13:21:45.133 2008-01-14 13:22:23.943 3113115 12222474 12255242 21 2008-05-08 11:37:22.423 2010-05-10 15:53:40.790 3637958 3113119 3178641 3 2008-01-14 13:21:45.133 2008-01-14 13:28:11.397 3113115 12222470 12255238 19 2008-05-08 11:37:22.423 2009-01-05 22:15:14.107 3637958 3707564 3113134 2008-04-28 12:42:06.653 2008-04-28 12:42:06.653 3707563 3113134 2008-04-28 12:42:06.650 2008-04-28 12:42:06.650 3707562 3113134 2008-04-28 12:42:06.650 2008-04-28 12:42:06.650 3113025 3178557 29 2006-10-18 08:21:22.650 2007-12-07 16:01:42.087 22 3638067 3670813 117 2008-01-14 13:21:45.133 2008-05-12 12:39:51.567 3113115 3113026 3178558 30 2006-10-18 08:21:22.650 2008-01-09 10:58:47.090 22 3638070 3670815 5 2008-05-12 12:14:25.300 2008-05-12 12:37:36.907 3638049 3638072 3670817 119 2008-01-14 13:21:45.133 2008-05-12 12:54:51.730 3113115 3638071 3670816 118 2008-01-14 13:21:45.133 2008-05-12 12:49:08.943 3113115 3638060 3670807 116 2008-01-14 13:21:45.133 2008-05-12 12:38:21.713 3113115 3638059 3670806 115 2008-01-14 13:21:45.133 2008-05-08 11:51:27.557 3113115 3638062 3670809 6 2008-05-08 11:40:40.903 2008-05-08 12:08:10.483 3637963 3638064 3670811 7 2008-05-08 11:40:40.903 2008-05-12 12:46:27.247 3637963 3638024 3670771 2 2008-05-08 11:36:29.567 2008-05-08 12:11:54.677 3637956 3637999 3670746 6 2008-05-08 11:37:22.423 2008-05-08 12:45:47.883 3637958 3638002 3670749 7 2008-05-08 11:37:22.423 2008-05-08 12:48:45.047 3637958 1835053 1867817 1 2007-04-16 16:20:48.017 2007-04-16 16:20:48.017 589949 3637998 3670745 5 2008-05-08 11:37:22.423 2008-05-08 12:45:18.640 3637958 3637997 3670744 4 2008-05-08 11:37:22.423 2008-05-08 12:12:43.663 3637958 3638057 3670804 4 2008-05-12 12:14:25.300 2008-05-12 12:36:47.827 3638049 3638055 3670802 3 2008-05-12 12:14:25.300 2008-05-12 12:34:55.827 3638049 3638053 3670800 2 2008-05-12 12:14:25.300 2008-05-12 12:32:26.080 3638049 3638051 3670798 1 2008-05-12 12:14:25.300 2008-05-12 12:14:25.300 3638049 1246305 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246304 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 3113418 3178926 48 2008-01-14 13:21:45.133 2008-01-30 16:02:07.667 3113115 1246306 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246301 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246300 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246303 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246302 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246297 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246296 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246299 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246298 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 1246293 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 1246292 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 1246295 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 589927 622693 14 2006-10-18 08:21:22.650 2007-02-22 09:48:05.113 22 1246294 604 2007-07-16 16:17:52.533 2007-07-16 16:17:52.533 3637950 3670699 112 2008-01-14 13:21:45.133 2008-05-07 13:43:11.263 3113115 3637954 3670704 50 2006-10-18 08:21:22.650 2008-04-29 13:38:01.547 22 3113396 3178905 46 2008-01-14 13:21:45.133 2008-01-30 15:49:57.933 3113115 8454523 589949 2009-01-08 15:08:26.237 2009-01-08 15:08:26.237 3113398 3178907 47 2008-01-14 13:21:45.133 2008-01-30 16:00:54.287 3113115 4882459 5 2008-06-03 12:43:06.423 2008-06-03 12:43:06.423 589910 622677 28 2007-02-21 14:32:30.070 2007-04-09 10:10:13.987 938 3113392 3178901 44 2008-01-14 13:21:45.133 2008-01-30 15:44:21.943 3113115 589909 622676 3 2007-02-21 14:45:41.660 2007-03-09 13:36:35.437 946 589908 622675 27 2007-02-21 14:32:30.070 2007-03-12 15:34:08.307 938 3113394 3178903 45 2008-01-14 13:21:45.133 2008-01-30 15:47:42.003 3113115 3113388 3178897 42 2008-01-14 13:21:45.133 2008-01-30 15:38:34.900 3113115 589912 622679 30 2007-02-21 14:32:30.070 2007-04-09 12:19:23.920 938 3113390 3178899 43 2008-01-14 13:21:45.133 2008-01-30 15:39:31.240 3113115 589911 622678 29 2007-02-21 14:32:30.070 2007-04-09 12:19:04.080 938 3637965 3670712 51 2006-10-18 08:21:22.650 2008-05-08 11:35:46.357 22 3637967 3670714 1 2008-05-08 11:40:40.903 2008-05-08 11:40:40.903 3637963 3637969 3670716 113 2008-01-14 13:21:45.133 2008-05-08 11:28:06.457 3113115 3637972 3670719 114 2008-01-14 13:21:45.133 2008-05-08 11:45:12.537 3113115 3637974 3670721 2 2008-05-08 11:40:40.903 2008-05-08 11:43:10.590 3637963 3637976 3670723 14 2008-01-17 15:30:30.480 2008-02-05 12:33:36.680 3113240 3637978 3670725 3 2008-05-08 11:40:40.903 2008-05-08 11:52:37.070 3637963 1246290 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 1246291 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 3637979 3670726 1 2008-05-08 11:37:22.423 2008-05-08 11:37:22.423 3637958 1246288 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 3637982 3670729 4 2008-05-08 11:40:40.903 2008-05-08 12:01:50.483 3637963 1246289 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 3637981 3670728 2 2008-05-08 11:37:22.423 2008-05-08 12:04:56.623 3637958 1246286 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 3637984 3670731 5 2008-05-08 11:40:40.903 2008-05-08 12:06:33.750 3637963 1246287 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 1246285 604 2007-07-16 16:17:52.530 2007-07-16 16:17:52.530 3637987 3670734 1 2008-05-08 11:33:35.547 2008-05-08 11:33:35.547 3637952 3113421 3178929 50 2008-01-14 13:21:45.133 2008-01-31 13:44:39.600 3113115 3113422 3178930 51 2008-01-14 13:21:45.133 2008-01-31 13:45:22.267 3113115 3637991 3670738 1 2008-05-08 11:36:29.567 2008-05-08 11:36:29.567 3637956 3113420 3178928 49 2008-01-14 13:21:45.133 2008-01-31 13:43:15.190 3113115 3637993 3670740 3 2008-05-08 11:37:22.423 2008-05-08 12:05:57.113 3637958 3637873 3670623 4 2008-05-07 09:57:14.667 2008-05-07 10:31:57.870 3637864 3113347 3178858 27 2008-01-14 13:21:45.133 2008-01-30 11:21:15.430 3113115 3637872 3670622 104 2008-01-14 13:21:45.133 2008-05-02 13:30:35.110 3113115 3113349 3178860 28 2008-01-14 13:21:45.133 2008-01-30 11:27:32.230 3113115 3113352 3178863 30 2008-01-14 13:21:45.133 2008-01-30 11:30:28.573 3113115 3113351 3178862 29 2008-01-14 13:21:45.133 2008-01-30 11:28:36.503 3113115 3637870 3670620 3 2008-05-07 09:57:14.667 2008-05-07 10:04:45.730 3637864 3637868 3670618 2 2008-05-07 09:57:14.667 2008-05-07 10:02:03.117 3637864 3637881 3670631 109 2008-01-14 13:21:45.133 2008-05-07 11:21:31.280 3113115 3637882 3670633 110 2008-01-14 13:21:45.133 2008-05-07 11:21:57.160 3113115 3113339 3178850 24 2008-01-14 13:21:45.133 2008-01-17 16:12:55.107 3113115 3637879 3670629 107 2008-01-14 13:21:45.133 2008-05-07 11:18:32.133 3113115 3113342 3178853 26 2008-01-14 13:21:45.133 2008-01-30 11:20:53.057 3113115 3637880 3670630 108 2008-01-14 13:21:45.133 2008-05-07 11:20:54.060 3113115 3113341 3178852 25 2008-01-14 13:21:45.133 2008-01-30 11:19:23.727 3113115 3637877 3670627 106 2008-01-14 13:21:45.133 2008-05-07 11:14:18.490 3113115 3113344 3178855 8 2008-01-17 15:30:30.480 2008-01-17 16:11:01.857 3113240 3637875 3670625 105 2008-01-14 13:21:45.133 2008-05-07 10:57:53.913 3113115 3113345 3178856 9 2008-01-17 15:30:30.480 2008-01-30 11:25:22.560 3113240 3637896 3670647 111 2008-01-14 13:21:45.133 2008-05-07 13:17:50.353 3113115 3113325 3178837 9 2008-01-15 11:41:47.420 2008-01-17 11:53:04.730 3113134 3113327 3178838 2 2008-01-17 15:30:48.920 2008-01-17 15:32:36.717 3113242 3113382 3178891 39 2008-01-14 13:21:45.133 2008-01-30 12:52:59.730 3113115 3113380 3178889 38 2008-01-14 13:21:45.133 2008-01-30 12:48:49.973 3113115 3113386 3178895 41 2008-01-14 13:21:45.133 2008-01-30 12:56:51.490 3113115 3637900 3670650 5 2008-05-07 09:57:14.667 2008-05-07 11:00:14.507 3637864 3113384 3178893 40 2008-01-14 13:21:45.133 2008-01-30 12:55:41.550 3113115 3113373 3178882 34 2008-01-14 13:21:45.133 2008-01-30 12:33:34.490 3113115 3113372 3178881 33 2008-01-14 13:21:45.133 2008-01-30 12:25:47.790 3113115 3113378 3178887 37 2008-01-14 13:21:45.133 2008-01-30 12:45:16.210 3113115 3113376 3178885 36 2008-01-14 13:21:45.133 2008-01-30 12:44:44.437 3113115 3113375 3178884 35 2008-01-14 13:21:45.133 2008-01-30 12:38:11.680 3113115 3113364 3178874 31 2008-01-14 13:21:45.133 2008-01-30 11:31:00.637 3113115 3113370 3178879 32 2008-01-14 13:21:45.133 2008-01-30 12:15:09.810 3113115 2230487 2163060 2007-12-07 15:58:09.537 2007-12-07 15:58:09.537 2230486 2163060 2007-12-07 15:58:09.537 2007-12-07 15:58:09.537 2230489 2163060 2007-12-07 15:58:09.537 2007-12-07 15:58:09.537 2230488 2163060 2007-12-07 15:58:09.537 2007-12-07 15:58:09.537 3735611 3638049 2008-05-12 12:26:43.563 2008-05-12 12:26:43.563 18906 1 3735610 3638049 2008-05-12 12:18:58.347 2008-05-12 12:18:58.347 10247 1 3735609 3735613 3638049 2008-05-12 12:26:55.803 2008-05-12 12:26:55.803 21463 1 3637811 3670563 102 2008-01-14 13:21:45.133 2008-05-01 12:38:18.093 3113115 3735612 3638049 2008-05-12 12:26:50.317 2008-05-12 12:26:50.317 22770 1 222 177 22 2007-01-03 14:44:15.063 2009-10-19 16:32:15.083 3735606 3637956 2008-05-08 12:11:06.463 2008-05-08 12:11:06.463 207407 1 223 10 22 2007-01-08 06:27:15.057 2007-05-21 10:35:15.063 3735609 3638049 2008-05-12 12:18:58.347 2008-05-12 12:26:36.810 17192 2 225 1 581 2007-01-11 10:13:15.027 2007-01-11 10:13:15.027 3735608 3638049 2008-05-12 12:18:46.927 2008-05-12 12:18:46.927 38759 1 3735603 3637958 2008-05-08 12:02:43.760 2008-05-08 12:02:43.760 6928 1 3637805 3670557 99 2008-01-14 13:21:45.133 2008-04-30 16:56:54.137 3113115 3735605 3637952 2008-05-08 12:09:32.673 2008-05-08 12:09:32.673 197159 1 3637803 3670555 98 2008-01-14 13:21:45.133 2008-04-30 16:50:55.667 3113115 3735604 3637952 2008-05-08 12:08:51.277 2008-05-08 12:08:51.277 6928 1 3637809 3670561 101 2008-01-14 13:21:45.133 2008-05-01 12:36:51.200 3113115 3637807 3670559 100 2008-01-14 13:21:45.133 2008-04-30 17:22:25.443 3113115 3113264 3178781 22 2008-01-14 13:21:45.133 2008-01-17 15:48:32.547 3113115 3113263 3178780 7 2008-01-17 15:30:30.480 2008-01-17 16:06:06.810 3113240 3113266 3178783 23 2008-01-14 13:21:45.133 2008-01-17 16:11:49.563 3113115 3735590 3113115 2008-04-30 16:53:52.630 2008-04-30 16:53:52.630 207407 1 3113259 3178776 5 2008-01-17 15:30:30.480 2008-01-17 15:59:22.713 3113240 241 3 604 2007-01-29 13:10:15.053 2007-02-23 10:30:15.030 3113261 3178778 6 2008-01-17 15:30:30.480 2008-01-17 16:02:38.260 3113240 3735588 22 2008-04-29 13:37:31.117 2008-04-29 13:37:31.117 92053 1 3735589 3113115 2008-04-30 16:53:44.503 2008-04-30 16:53:44.503 197159 1 3637826 3670576 103 2008-01-14 13:21:45.133 2008-05-01 13:04:48.783 3113115 253 2 22 2007-02-23 10:13:15.030 2007-02-23 10:16:15.030 256 1 604 2007-02-23 10:31:15.033 2007-02-23 10:31:15.033 360449 2 938 2007-03-12 14:02:15.020 2007-04-16 15:36:15.047 10355736 10388463 92 2006-10-18 08:21:22.650 2009-05-15 13:29:58.160 22 2230310 2163047 2007-12-06 15:16:31.923 2007-12-06 15:16:31.923 254 1 604 2007-02-23 10:31:15.030 2007-02-23 10:31:15.030 2230309 2163047 2007-12-06 15:16:31.923 2007-12-06 15:16:31.923 255 2 604 2007-02-23 10:31:15.030 2007-02-23 10:32:15.027 5374391 5407130 60 2007-02-21 14:32:30.070 2007-12-07 15:16:43.647 938 5374392 5407131 61 2007-02-21 14:32:30.070 2008-06-23 10:26:03.467 938 5374394 5407133 4 2007-02-21 14:45:41.660 2007-04-09 10:11:39.507 946 3637862 3670612 16 2007-12-05 08:57:43.203 2008-02-21 14:43:49.220 2163017 5374396 5407135 6 2007-02-21 14:45:41.660 2008-06-23 10:30:48.873 946 5374395 5407134 5 2007-02-21 14:45:41.660 2008-06-23 10:30:20.157 946 5374398 5407137 62 2007-02-21 14:32:30.070 2008-06-23 10:26:56.870 938 3637866 3670616 1 2008-05-07 09:57:14.667 2008-05-07 09:57:14.667 3637864 9076798 8913345 2009-02-09 09:49:02.203 2009-02-09 10:03:33.457 3530 3 9076792 9076799 8913345 2009-02-09 09:49:02.220 2009-02-09 10:03:33.470 83449 3 9076793 9076801 8913345 2009-02-09 09:49:02.203 2009-02-09 10:29:18.333 5017 4 9076792 9076802 8913345 2009-02-09 09:49:02.220 2009-02-09 10:29:18.340 59966 4 9076793 9076803 8913345 2009-02-09 09:49:02.203 2009-02-09 14:07:08.913 5265 5 9076792 5374403 5407142 63 2007-02-21 14:32:30.070 2008-06-23 10:48:02.320 938 9076804 8913345 2009-02-09 09:49:02.220 2009-02-09 14:07:08.943 62654 5 9076793 5374405 5407144 64 2007-02-21 14:32:30.070 2008-06-23 10:52:29.867 938 3113211 3178730 13 2008-01-14 13:21:45.133 2008-01-17 11:33:28.577 3113115 9076797 8913345 2009-02-09 09:49:02.220 2009-02-09 10:00:50.257 62932 2 9076793 3637754 3670507 46 2006-10-18 08:21:22.650 2008-04-28 12:33:53.457 22 9076796 8913345 2009-02-09 09:49:02.203 2009-02-09 10:00:50.227 1859 2 9076792 3113213 3178732 14 2008-01-14 13:21:45.133 2008-01-17 11:34:07.517 3113115 9076795 8913345 2009-02-09 09:49:02.220 2009-02-09 09:49:02.220 6589 1 9076793 3637752 3670505 45 2006-10-18 08:21:22.650 2008-04-28 12:33:01.237 22 9076794 8913345 2009-02-09 09:49:02.203 2009-02-09 09:49:02.203 223 1 9076792 3637751 3670504 44 2006-10-18 08:21:22.650 2008-04-28 12:32:16.957 22 6946827 6979595 78 2006-10-18 08:21:22.650 2008-10-23 10:20:48.493 22 9076793 8913345 2009-02-09 09:49:02.220 2009-02-10 11:17:53.713 61562 6 6946834 6979602 1 2008-10-23 17:00:01.580 2008-10-23 17:00:01.580 6946832 3113215 3178734 25 2007-05-10 15:13:11.397 2008-01-15 11:42:24.800 917532 9076792 8913345 2009-02-09 09:49:02.203 2009-02-10 11:17:53.690 5255 6 3637749 3670502 43 2006-10-18 08:21:22.650 2008-04-28 12:31:30.090 22 3113218 3178737 6 2008-01-15 11:41:47.420 2008-01-15 11:59:18.760 3113134 3637747 3670500 42 2006-10-18 08:21:22.650 2008-04-28 12:29:16.133 22 622704 589939 622694 589928 3113220 3178739 7 2008-01-15 11:41:47.420 2008-01-17 11:50:17.713 3113134 3637745 3670498 41 2006-10-18 08:21:22.650 2008-02-21 13:38:57.337 22 6946837 6979605 79 2006-10-18 08:21:22.650 2008-10-23 16:10:51.610 22 3113221 3178740 8 2008-01-15 11:41:47.420 2008-01-17 11:52:18.877 3113134 3637744 3670497 5 2007-01-19 16:04:18.030 2007-01-19 16:11:10.920 659 6946836 6979604 2 2008-10-23 17:00:01.580 2008-10-23 17:20:02.067 6946832 3637743 3670496 12 2008-01-15 11:41:47.420 2008-04-28 12:26:22.830 3113134 3113222 3178741 31 2006-10-18 08:21:22.650 2008-01-09 11:00:37.493 22 3113224 3178743 15 2008-01-14 13:21:45.133 2008-01-17 11:43:16.660 3113115 3637741 3670494 11 2008-01-15 11:41:47.420 2008-04-28 12:24:17.450 3113134 622695 589930 6946840 6979608 4 2008-10-23 17:00:01.580 2008-10-23 17:35:01.697 6946832 3113226 3178745 16 2008-01-14 13:21:45.133 2008-01-17 12:09:12.720 3113115 3637739 3670492 10 2008-01-15 11:41:47.420 2008-01-29 15:22:50.037 3113134 6946839 6979607 3 2008-10-23 17:00:01.580 2008-10-23 17:25:42.177 6946832 3637769 3670521 81 2008-01-14 13:21:45.133 2008-04-28 13:56:29.197 3113115 3113195 3178714 8 2008-01-14 13:21:45.133 2008-01-16 15:58:36.310 3113115 3637767 3670519 80 2008-01-14 13:21:45.133 2008-04-28 13:33:33.803 3113115 3113197 3178716 9 2008-01-14 13:21:45.133 2008-01-16 16:43:56.020 3113115 3637765 3670517 79 2008-01-14 13:21:45.133 2008-04-24 13:12:11.607 3113115 3113199 3178718 10 2008-01-14 13:21:45.133 2008-01-16 16:47:23.347 3113115 3113202 3178721 6 2007-01-25 13:56:07.397 2007-02-02 11:51:59.367 698 4849670 1 22 2008-06-03 12:43:15.033 2008-06-03 12:43:15.033 3113201 3178720 11 2008-01-14 13:21:45.133 2008-01-16 16:54:00.443 3113115 3637762 3670514 15 2008-01-15 11:41:47.420 2008-04-28 12:39:10.750 3113134 19041131 19073822 23 2009-05-15 13:14:57.057 2012-06-20 15:53:28.417 9798548 3637760 3670512 14 2008-01-15 11:41:47.420 2008-04-28 12:36:59.427 3113134 3637757 3670510 22 2007-06-07 15:42:27.210 2008-01-17 15:45:51.060 1179679 589965 622728 6 2007-03-12 11:17:25.610 2007-04-18 05:10:14.687 163852 589966 622729 33 2007-02-21 14:32:30.070 2007-04-16 16:55:54.610 938 589963 622726 28 2007-01-18 15:59:19.917 2007-04-16 16:29:03.267 604 3637755 3670508 47 2006-10-18 08:21:22.650 2008-04-28 12:36:44.997 22 622712 589949 3113209 3178728 12 2008-01-14 13:21:45.133 2008-01-16 17:08:45.307 3113115 3637756 3670509 13 2008-01-15 11:41:47.420 2008-04-28 12:27:12.097 3113134 589964 622727 5 2007-03-12 11:17:25.610 2007-04-16 16:18:08.093 163852 3637784 3670536 49 2006-10-18 08:21:22.650 2008-04-29 13:30:16.037 22 3113245 3178762 2 2008-01-17 15:30:30.480 2008-01-17 15:32:14.587 3113240 3637783 3670535 48 2006-10-18 08:21:22.650 2008-04-28 12:36:59.420 22 3113246 3178763 1 2008-01-17 15:30:48.920 2008-01-17 15:30:48.920 3113242 3637786 3670538 89 2008-01-14 13:21:45.133 2008-04-28 16:29:52.623 3113115 3113243 3178760 17 2007-06-07 15:42:27.210 2008-01-16 11:41:07.553 1179679 589962 622725 13 2007-03-01 08:35:46.057 2007-03-12 11:18:20.147 1023 589961 622724 2 2007-02-05 14:31:16.673 2007-03-12 11:11:03.977 769 3113244 3178761 1 2008-01-17 15:30:30.480 2008-01-17 15:30:30.480 3113240 3637780 3670532 87 2008-01-14 13:21:45.133 2008-04-28 16:05:22.097 3113115 3113249 3178766 3 2008-01-17 15:30:30.480 2008-01-17 15:32:27.297 3113240 3637781 3670533 88 2008-01-14 13:21:45.133 2008-04-28 16:09:03.853 3113115 3113248 3178765 18 2007-06-07 15:42:27.210 2008-01-17 15:32:02.973 1179679 3637776 3670528 85 2008-01-14 13:21:45.133 2008-04-28 15:16:31.843 3113115 589952 622715 27 2007-01-18 15:59:19.917 2007-04-11 10:05:07.347 604 3113253 3178770 21 2007-06-07 15:42:27.210 2008-01-17 15:45:34.357 1179679 589951 622714 26 2007-02-05 15:44:32.787 2007-04-16 16:24:53.370 780 3637778 3670530 86 2008-01-14 13:21:45.133 2008-04-28 15:42:45.667 3113115 3113251 3178768 19 2007-06-07 15:42:27.210 2008-01-17 15:33:59.507 1179679 3113252 3178769 20 2007-06-07 15:42:27.210 2008-01-17 15:38:04.530 1179679 589953 622716 32 2007-02-21 14:32:30.070 2007-04-16 15:25:19.303 938 589948 622711 4 2007-03-12 11:17:25.610 2007-04-16 16:16:55.223 163852 3113257 3178774 4 2008-01-17 15:30:30.480 2008-01-17 15:34:09.643 3113240 3637771 3670523 82 2008-01-14 13:21:45.133 2008-04-28 13:58:36.197 3113115 589947 622710 3 2007-03-12 11:17:25.610 2007-04-16 16:16:43.943 163852 3637774 3670526 84 2008-01-14 13:21:45.133 2008-04-28 15:03:04.557 3113115 589950 622713 25 2007-02-05 15:44:32.787 2007-03-12 10:55:05.867 780 3637773 3670525 83 2008-01-14 13:21:45.133 2008-04-28 13:59:50.517 3113115 3113256 3178773 21 2008-01-14 13:21:45.133 2008-01-17 15:28:58.810 3113115 3637799 3670551 96 2008-01-14 13:21:45.133 2008-04-30 14:22:17.417 3113115 9076746 8913021 2009-01-23 11:12:33.780 2009-01-23 11:12:33.780 13351 1 589943 622706 2 2007-04-12 10:36:43.443 2007-04-12 11:06:29.073 589939 9076747 8913021 2009-01-23 11:12:38.097 2009-01-23 11:12:38.097 1205 1 589944 622707 31 2007-02-21 14:32:30.070 2007-04-09 12:20:35.663 938 3637801 3670553 97 2008-01-14 13:21:45.133 2008-04-30 16:30:13.437 3113115 9076748 8913021 2009-01-23 11:12:43.193 2009-01-23 11:12:43.193 55748 1 589945 622708 1 2007-03-12 11:17:25.610 2007-03-12 11:17:25.610 163852 9076749 8913021 2009-01-23 11:32:20.577 2009-01-23 11:32:20.577 8783 1 589946 622709 2 2007-03-12 11:17:25.610 2007-04-16 16:12:59.293 163852 3637795 3670547 93 2008-01-14 13:21:45.133 2008-04-30 14:17:09.417 3113115 3113234 3178753 18 2008-01-14 13:21:45.133 2008-01-17 14:27:26.377 3113115 9076742 8913021 2009-01-23 11:12:15.497 2009-01-23 11:12:15.497 20067 1 3637796 3670548 94 2008-01-14 13:21:45.133 2008-04-30 14:18:10.287 3113115 9076743 8913021 2009-01-23 11:12:19.057 2009-01-23 11:12:19.057 13257 1 204 2 22 2006-12-01 15:01:15.020 2007-01-29 13:10:15.067 3637797 3670549 95 2008-01-14 13:21:45.133 2008-04-30 14:19:21.593 3113115 3113232 3178751 17 2008-01-14 13:21:45.133 2008-01-17 12:19:58.007 3113115 9076744 8913021 2009-01-23 11:12:22.983 2009-01-23 11:12:22.983 18583 1 6946817 6979585 77 2006-10-18 08:21:22.650 2008-10-13 12:12:45.817 22 9076745 8913021 2009-01-23 11:12:29.100 2009-01-23 11:12:29.100 10514 1 589942 622705 1 2007-04-12 10:36:43.443 2007-04-12 10:36:43.443 589939 3637791 3670543 91 2008-01-14 13:21:45.133 2008-04-30 13:37:01.030 3113115 3113238 3178757 20 2008-01-14 13:21:45.133 2008-01-17 15:17:40.487 3113115 9076738 8913021 2009-01-23 11:11:57.410 2009-01-23 11:11:57.410 24075 1 6946819 6979587 11 2008-08-20 12:41:51.660 2008-10-06 11:18:45.837 6258828 3735616 3638049 2008-05-12 12:27:23.950 2008-05-12 12:27:23.950 19810 1 9076739 8913021 2009-01-23 11:12:03.413 2009-01-23 11:12:03.413 23006 1 589936 622701 2 2007-04-11 09:59:56.567 2007-04-11 10:00:13.363 589930 3735617 3638049 2008-05-12 12:27:33.387 2008-05-12 12:27:33.387 15660 1 3637793 3670545 92 2008-01-14 13:21:45.133 2008-04-30 14:12:26.867 3113115 3113236 3178755 19 2008-01-14 13:21:45.133 2008-01-17 15:07:36.087 3113115 9076740 8913021 2009-01-23 11:12:07.047 2009-01-23 11:12:07.047 13446 1 3735614 3638049 2008-05-12 12:27:08.543 2008-05-12 12:27:08.543 20516 1 9076741 8913021 2009-01-23 11:12:10.823 2009-01-23 11:12:10.823 14061 1 589938 622703 1 2007-04-11 09:50:01.490 2007-04-11 09:50:01.490 589928 3735615 3638049 2008-05-12 12:27:13.550 2008-05-12 12:27:13.550 28144 1 589931 622696 1 2007-04-11 09:59:56.567 2007-04-11 09:59:56.567 589930 589932 622697 26 2007-01-18 15:59:19.917 2007-02-23 11:00:47.617 604 3735618 3638049 2008-05-12 12:27:43.260 2008-05-12 12:27:43.260 15514 1 3637790 3670542 90 2008-01-14 13:21:45.133 2008-04-30 13:02:00.677 3113115 9076737 8913021 2009-01-23 11:10:50.127 2009-01-23 11:10:50.127 22997 1 9831319 /condor_config.local. Add the START expression, and TRUST_UID_DOMAIN {code} START = ( $(CPUIdle) || (State != "Unclaimed" && State != "Owner")) TRUST_UID_DOMAIN = True UID_DOMAIN = $(FULL_HOSTNAME) {code} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat}\\ \\ \\ \\ \\ ]]> 9798575 950279 917511 8093795 8061033 9831320 9798576 950282 917515 9831321 9798577 9831322 9798578 950276 917508 1212484 e.g. dcline@mbari {noformat} * Create condor.sh file in /etc/profile.d and add the following: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} * Restart sendmail {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} h2. AVED account, and the /etc/aliases File If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved: dcline@mbari.org {noformat}]]> 1179716 9831315 9798571 950275 917507 1212483 e.g. dcline@mbari {noformat} * Create condor.sh file in /etc/profile.d and add the following: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} * Restart sendmail {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 1179715 9831316 /condor_config.local. Add the START expression, and TRUST_UID_DOMAIN {code} START = ( $(CPUIdle) || (State != "Unclaimed" && State != "Owner")) TRUST_UID_DOMAIN = True {code} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat}\\ \\ \\ \\ \\ ]]> 9798572 950278 917510 9831317 9798573 950277 917509 1212485 e.g. dcline@mbari {noformat} * Create condor.sh file in /etc/profile.d and add the following: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} * Restart sendmail {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} h2. The /etc/mail/virtusertable File If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} ]]> 1179717 9831318 9798574 950288 917521 950287 917520 9831328 9798584 950290 917523 950289 917522 950284 917517 950283 917516 9831324 9798580 950286 917519 9831325 9798581 950285 917518 950295 917528 9831304 9798560 950296 917529 950297 917530 9831306 9798562 950298 917531 950291 917524 9831300 9798556 950292 917525 950293 917526 9831302 9798558 950303 917536 9831312 9798568 950304 917537 9831311 9798567 950305 917538 1212513 1179746 950306 917539 1212514 1179747 9831308 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat}\\ \\ \\ \\ \\ ]]> 9798564 950300 917533 950301 917534 9831310 9798566 950302 917535 9831309 9798565 950312 917545 950311 917544 950309 917542 950308 917541 1212516 1179749 950307 917540 1212515 1179748 950322 917555 950321 917554 1212529 1179762 950320 917553 1212528 1179761 950330 917563 1212535 1179768 950328 917561 950325 917558 8093785 8061022 950326 917559 950323 917556 1212531 e.g. dcline@mbari {noformat} * Create condor.sh file in /etc/profile.d and add the following: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} ]]> 1179764 8093783 8061020 950324 917557 1212532 e.g. dcline@mbari {noformat} h2. Installing Condor as a service   \\ * Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager Run configure script to setup installation as a submit and execute only node to the central manager nanomia {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 1179765 8093784 8061021 8093789 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 8061027 8093790 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 8061028 950335 917568 950336 917569 950333 917566 8093793 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 8061031 950334 917567 950332 917565 8093792 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 8061030 8093731 8060966 8093733 8060968 950348 917581 950352 {code}]]> 917586 950354 917588 950353 frameRate field. {note} !AVED Event Classes.jpg! h2. XML Sample {code} {code}]]> 917587 2195846 2163082 950359 917593 1212439 1179671 950360 917594 1212440 1179672 1212446 1179678 1212448 1179680 1212449 1179681 1212450 1179682 1212454 e.g. dcline@mbari {noformat} * Create condor.sh file in /etc/profile.d an add {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default configuration to work with the MBARI email server: * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Restart sendmail {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 1179686 1212453 1179685 1212452 1179684 1212451 1179683 1212455 e.g. dcline@mbari {noformat} * Create condor.sh file in /etc/profile.d an add {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} * Restart sendmail {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 1179687 10388047 10355315 9831397 9798658 9831395 9798656 1212473 1179705 1212481 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer Ephyra but this computer can get heavy use so we'll need to move this to another Mac/Windows computer.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 1179713 1212482 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer Ephyra but this computer can get heavy use so we'll need to move this to another Mac/Windows computer.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 1179714 1212480 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer Ephyra but this computer can get heavy use so we'll need to move this to another Mac/Windows computer.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 1179712 1212623 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software]workflow software. The AVI use the same vcodec in the final EITS experiment.  The diagram below shows the activities on  particular servers, inputs and output files, and the data storage locations.    !EITS AVED Processing Workflow Milestone1.jpg! h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179857 1212624 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software]workflow software. The AVI use the same vcodec in the final EITS experiment.  The diagram below shows the activities on  particular servers, inputs and output files, and the data storage locations. \\ h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179858 2195779 2163015 1212625 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software]workflow software. The AVI use the same vcodec in the final EITS experiment.   This diagram shows the activities on particular servers, inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view. !EITS AVED Processing Workflow Milestone1.jpg|thumbnail! \\   h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179859 2195782 2163018 1212626 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software]workflow software. The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers, inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.   !EITS AVED Processing Workflow Milestone1.jpg|thumbnail! \\   h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Server and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179860 1212619 1179853 1212620 http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1. For the EITS milestone1 experiment, it will be e.g.file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. AVED Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software]workflow software. The AVI use the same vcodec in the final EITS experiment.  The diagram below shows the activities on  particular servers, inputs and output files, and the data storage locations.    !EITS AVED Processing Workflow Milestone1.jpg! h4. AVED Deployment Diagram \\ h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179854 2195783 2163019 1212621 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software]workflow software. The AVI use the same vcodec in the final EITS experiment.  The diagram below shows the activities on  particular servers, inputs and output files, and the data storage locations.    !EITS AVED Processing Workflow Milestone1.jpg! h4. AVED Deployment Diagram \\ h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179855 1212622 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software]workflow software. The AVI use the same vcodec in the final EITS experiment.  The diagram below shows the activities on  particular servers, inputs and output files, and the data storage locations.    !EITS AVED Processing Workflow Milestone1.jpg! h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing. !EITS AVED Deployment Milestone 1.jpg! \\ h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179856 1212615 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 1179849 1212616 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 1179850 1212617 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} [~erikar] The above quote is correct.  Lee will need an API from you to make calls and put data into the VARS system. [~brian] _From Feb 23rd 2007 conference call:_ Lee will deliver Video files ans CSV text anxillary data to the RAID drive on shore. We will write up a loader to stuff the anxillary data into EITS database tables. {panel} {panel} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. [~erikar] We still plan to keep all the original data from the mirrored RAID, as you mentioned.  It is my understanding that we will also need to have VARS and AVED loaded onto a computer here in Florida if we want to edit any AVED events; however, the computer in Florida will not require the same cluster arrangement as the AVED processing computer at MBARI.  Is this correct?  Our group will pay for the computer in Florida. {color:#0000cc}Yes, you will not need a cluster. The project has allocated time to setup a workstation for deployment at ORCA which will have what you need to edit the events.  We also have travel money to come to Florida to help setup this computer and for any needed training. I imagine this computer will be a mirrored setup to what we have on the shore-side system here at MBARI (AVED, VARS, etc.), but we still need to work out those details.{color} {panel} {panel} *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. [~brian] _From Feb 23rd 2007 conference call:_ The current plan is to host a _replicated_ database both at MBARI and ORCA. MySQL 5.0 does support replication but we'll need to test this. [~brian] From [2007-04-11]. Setting up a server for integration testing. _mbari649_ (Mac OS X 10.4) is being setup with MySQL 5, Apache, and Darwin Streaming Server. Also setting up automount of RAID on nanomia. {panel} {panel} *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. [~erikar] Lee had a suggestion.  In the beginning we store 3 different video archives 1) all raw EITS data 2) AVED processed data and 3) edited AVED data.  VARS would have three fields, one for each archive.  The pointers in VARS would specify a directory path to the correct archive.  I can explain this better over the phone if you want to call me 772-321-5879. [~brian] _From Feb 23rd 2007 conference call:_ We will run though a demonstration of the entire data flow before we decide how to manage reprocessing. {panel} {panel} *Q. Where will the EITS computers live?* Initially at MBARI  {panel} {panel} *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} [~erikar] Lee will provide you with a time-code from EITS [~brian] _From Feb 23rd 2007 conference call:_ -Lee is going to investigate using a QuickTime container with MPEG-4 encoding. We'll send him sample code of how to write a TimeCode track.- TimeCode will be written as GMT/UTC time. [~brian] The current plan is for us to add the TimeCode track as part of our workflow. We have a script for doing this. {panel} {panel} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote}{info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. {panel} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 1179851 1212618 1179852 2195792 2163028 2195794 2163030 1212614 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 1179848 2195793 2163029 2195795 2163031 2195796 2163032 2195797 2163033 2195798 2163034 2195799 2163035 2195800 2163036 2195801 2163037 1212631 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.   !EITS AVED Processing Workflow Milestone1.jpg|thumbnail! \\   h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179865 1212628 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.   !EITS AVED Processing Workflow Milestone1.jpg|thumbnail! \\   h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Server and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179862 1212627 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software]workflow software. The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers, inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.   !EITS AVED Processing Workflow Milestone1.jpg|thumbnail! \\   h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Server and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179861 1212630 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.   !EITS AVED Processing Workflow Milestone1.jpg|thumbnail! \\   h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179864 1212629 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing Workflow For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.   !EITS AVED Processing Workflow Milestone1.jpg|thumbnail! \\   h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Server and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 1179863 2195810 2163046 6979585 6946817 2195818 2163054 2195817 2163053 2195822 2163058 2195821 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.    !EITS AVED Processing Activity Milestone1.jpg|thumbnail!\\ h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 2163057 2195820 2163056 2195819 2163055 2195826 2163062 2195825 2163061 2195823 2163059 2195829 2163065 2195830 2163066 2195827 2163063 2195828 2163064 2195717 frameRate field.{color}{note} !AVED Event Classes.jpg! h2. XML Sample {code} {code}]]> 2162953 2195728 2162964 2195727 2162963 2195730 2162966 2195729 2162965 1212572 1179805 2195731 2162967 2195732 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ * Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} h1. Installing Condor As Execute-Only Node on Windows * Installation is from a .msi file. Just double click to install. * TODO: master setup instructions here * Java setup. \- Download scimark2lib from math.nist.gov/scimark2 and unpack into c:\condor\lib\scrimark2.  \-Edit the condor_config JAVA parameter - add quotes around the executable because "Program files" white space kills JAVA capability test, and add correct path to Windows JAVA.exe. {noformat} JAVA = "C:\Program Files\Java\jdk1.5.0_08\jre\bin\JAVA.EXE" {noformat} ]]> 2162968 1212566 e.g. dcline@mbari {noformat} h2. Installing Condor as a service \\ * Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} h1. Installing Condor As Execute-Only Node on Windows * Installation is from a .msi file. Just double click to install. * Java setup. \- Download scimark2lib from math.nist.gov/scimark2 and unpack into c:\condor\lib\scrimark2.   - Edit the condor_config JAVA parameter - add quotes around the executable because "Program files" white space kills JAVA capability test{noformat} JAVA = "C:\Program Files\Java\jdk1.5.0_08\jre\bin\JAVA.EXE" {noformat}* Add correct path to systems JAVA.exe.]]> 1179799 1212565 e.g. dcline@mbari {noformat} h2. Installing Condor as a service \\ * Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 1179798 9831294 9798550 9831293 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat}\\ \\ \\ \\ \\ ]]> 9798549 8093837 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 8061074 9831297 9798553 8093836 8061073 9831295 9798551 8093834 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 8061071 9831285 9798539 9831290 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat}\\ \\ \\ \\ \\ h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat} \[root@nanomia condor\]# rpm \-qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: \* Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} \* Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File \* If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, then skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} \* Otherwise, forward your mail to a legitimate MBARI user, e.g. dcline@mbari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 9798545 9831287 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat}\\ \\ \\ \\ \\ h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat} \[root@nanomia condor\]# rpm \-qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: \* Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} \* Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File \* If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, then skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} \* Otherwise, forward your mail to a legitimate MBARI user, e.g. dcline@mbari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 9798541 1212606 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 1179840 1212605 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer Ephyra but this computer can get heavy use so we'll need to move this to another Mac/Windows computer.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 1179839 2195778 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven At MBARI] or download the jars directly from [here|http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] h2. Testing Resources AVED processed data that is used for testing is currently hosted on Nanomia. Here's a few useful links: * EITS test data processed by Ishbel: [http://nanomia.shore.mbari.org/EITS_testing] * Test data with longer clips: [http://nanomia.shore.mbari.org/EITS_testing/RESULTS] * RAID storage for [~brian] mapped to _\\nanomia\RAID\brian_: [http://nanomia.shore.mbari.org/brian] ]]> 2163014 13959463 13926701 13959462 13926700 24084667 > ~/.profile {noformat} # Replace the local condor config file with EITS experiment settings in this [^condor_config.local] {noformat} sudo cp condor_config.local /opt/condor-7.4.2/local.somniosus/condor_config.local {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_master {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_off -master {noformat} # Use [Lingon|http://lingon.sourceforge.net/] to create a launchd item to execute {{condor_start.sh}} as a service. !org_mbari_eits_Condor_macLingon.png|thumbnail! # In Lingon, Click expert mode in the bottom right, then add the following {noformat} ... EnvironmentVariables CONDOR_CONFIG /opt/condor-7.4.2/etc/condor_config ... {noformat} ]]> 24051900 13959479 13926717 13959486 13926724 13959492 13926730 13959494 /view_client-2.0-Any-Java.tar.Z . [aved@nanomia condor] tar -zxvf view_client-2.0-Any-Java.tar.Z [aved@nanomia condor] tar -xvf view_client.tar {noformat} # Edit make_stats, changing ORGNAME, CONDORADMIN, etc. to reflect the installation, then run the installation {noformat} [aved@nanomia condor] ./make_stats setup [aved@nanomia condor] crontab cronentries {noformat} # The page should be visible [http://nanomia.shore.mbari.org/condor-view-applet/]. h1. MBARI Mail setup for Condor on Linux Condor can be configured to email to users on job completion, or failure. By default the root user will receive any emails if the condor daemons go awry. The following instructions are to setup the machine to correctly forward the emails. To send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat} [root@nanomia condor]# yum install sendmail-cf {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, then skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dcline@mbari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 13926732 9404418 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding  !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* # Launch a cygwin shell by clicking on the Desktop icon   !WMESSetup3.png! # Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv --install eitsstreaming --path /cygdrive/c/WINDOWS/system32/cscript.exe --args "C:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" -wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" -u erika {noformat} # The service should now show up in the services panel as *eitstreaming*, and from there you can start/stop it.  !WMESSetup4.png!]]> 9371650 19073822 /view_client-2.0-Any-Java.tar.Z . [root@nanomia condor] tar -zxvf view_client-2.0-Any-Java.tar.Z [root@nanomia condor] tar -xvf view_client.tar {noformat} * Edit make_stats, changing ORGNAME, CONDORADMIN, etc. to reflect the installation, then run the installation {noformat} [root@nanomia condor] ./make_stats setup [root@nanomia condor] crontab cronentries {noformat} * The page should be visible [http://nanomia.shore.mbari.org/condor-view-applet/]. h2. MBARI Mail setup Condor can be configured to email to users on job completion, or failure. By default the root user will receive any emails if the condor daemons go awry. The following instructions are to setup the machine to correctly forward the emails. To send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat} [root@nanomia condor]# yum install sendmail-cf {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, then skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dcline@mbari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 19041131 13172815 > ~/.profile {noformat} # Replace the local condor config file with EITS experiment settings in this [^condor_config.local] {noformat} sudo cp condor_config.local /opt/condor-7.4.2/local.somniosus/condor_config.local {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_master {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_off -master {noformat} # Use [Lingon|http://lingon.sourceforge.net/] to create a launchd item to execute {{condor_start.sh}} as a service. !org_mbari_eits_Condor_macLingon.png|thumbnail! # In Lingon, Click expert mode in the bottom right, then add the following {noformat} Disabled EnvironmentVariables CONDOR_CONFIG /opt/condor-7.4.2/etc/condor_config KeepAlive Label org.mbari.eits.Condor ProgramArguments /opt/condor-7.4.2/sbin/condor_start.sh RunAtLoad {noformat} ]]> 13140049 13172813 > ~/.profile {noformat} # Replace the local condor config file with EITS experiment settings in this [^condor_config.local] {noformat} sudo cp condor_config.local /opt/condor-7.4.2/local.somniosus/condor_config.local {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_master {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_off -master {noformat} # Use [Lingon|http://lingon.sourceforge.net/] to create a launchd item to execute {{condor_start.sh}} as a service. !org_mbari_eits_Condor_macLingon.png|thumbnail! ]]> 13140047 10388463 10355736 3670811 3638064 3178716 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, and cvsutils. h2. Installation notes Install aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts \\ Install EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} First, install {noformat}]]> 3113197 6226093 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp][EITS workflow scripts and cron job installation] h2. [EITS workflow scripts and cron job installation] [EITS web service installation] [EITS RAID directories] [EITS cron setup] [EITS rsync setup] ]]> 6258870 3670813 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS experiment workflow software installation|EITS:EITS computer workflow software setup] h2. [EITS web service installation notes]]]> 3638067 3178718 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, and cvsutils. h2. Installation notes Install aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} Install EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\]]> 3113199 6226091 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp][EITS workflow scripts and cron job installation] h2. h2. [EITS workflow scripts and cron job installation] [EITS web service installation] [EITS RAID directories]\\ [EITS cron setup] [EITS rsync setup]\\]]> 6258868 3670815 website_ !Picture 2.png|align=center! # A wizard will open, click next, then enter the description as _EITS Computer,_ then select Next !Picture 3.png|align=center! # Choose the mbari address 134.*.*.\* , then select Next !Picture 4.png|align=center! # Enter _C:\wwwroot_ for the root path of the home directory !Picture 5.png|align=center! # Select Read and Browse permissions, then select Next and click Finish on the final window. !Picture 6.png|align=center!\\ h1. Add a Virtual Directory to the RAID to make it visible for http access # Login as *Administrator.* # In the "Manage Your Server" window that opens at login, select _Manage this application Server_ !Picture 1.png|align=center! # Select New->VirtualDirectory !Picture 7.png|align=center! # A wizard will come up, and select next. Enter e for the alias to the E: drive !Picture 8.png|align=center! # Enter E:\ For the path to the directory that contains the contents !Picture 9.png|align=center! # Select Read and Browse permissions !Picture 10.png|align=center! Click Finish on the next window and you are done. The virtual directory should now show up as http:\\eits.shore.mbari.org\e in your web browser. ]]> 3638070 3178720 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. h2. Installation notes Install aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ Install EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ \\ \\  ]]> 3113201 3670816 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS experiment workflow software installation|EITS:EITS computer workflow software setup] h2. [EITS Computer Web Service Installation Notes |EITS:EiTS Computer Web Service Installation Note]]]> 3638071 6226096 website_ !Picture 2.png|align=center! # A wizard will open, click next, then enter the description as _EITS Computer,_ then select Next !Picture 3.png|align=center! # Choose the mbari address 134.*.*.\* , then select Next !Picture 4.png|align=center! # Enter _C:\wwwroot_ for the root path of the home directory !Picture 5.png|align=center! # Select Read and Browse permissions, then select Next and click Finish on the final window. !Picture 6.png|align=center!\\ h1. Add a Virtual Directory to the RAID to make it visible for http access # Login as *Administrator.* # In the "Manage Your Server" window that opens at login, select _Manage this application Server_ !Picture 1.png|align=center! # Select New->VirtualDirectory !Picture 7.png|align=center! # A wizard will come up, and select next. Enter e for the alias to the E: drive !Picture 8.png|align=center! # Enter E:\ For the path to the directory that contains the contents !Picture 9.png|align=center! # Select Read and Browse permissions !Picture 10.png|align=center! Click Finish on the next window and you are done. The virtual directory should now show up as http:\\eits.shore.mbari.org\e in your web browser. ]]> 6258873 3670817 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS experiment workflow software installation|EITS:EITS computer workflow software setup] h2. [EITS computer web service installation]]]> 3638072 6226095 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp][EITS workflow scripts and cron job installation] h2. Experiment software * [EITS workflow scripts and cron job installation] * [EITS web service installation] * [EITS RAID directories] * [EITS cron setup] * [EITS rsync setup]]]> 6258872 3178721 3113202 6226085 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS computer directory and workflow configuration|EITS RAID directories] h2. h2. [EITS web service installation] h2.]]> 6258862 3178707 3113188 3670804 website_ !Picture 2.png|align=center! # A wizard will open, click next, then enter the description as _EITS Computer,_ then select Next !Picture 3.png|align=center! # Choose the mbari address 134.*.*.\* , then select Next !Picture 4.png|align=center! # Enter _C:\wwwroot_ for the root path of the home directory !Picture 5.png|align=center! # Select Read and Browse permissions, then select Next and click Finish on the final window. !Picture 6.png|align=center!\\ h1. Add a Virtual Directory to the RAID to make it visible for http access # Login as *Administrator.* # In the "Manage Your Server" window that opens at login, select _Manage this application Server_ !Picture 1.png|align=center! Select New->VirtualDirectory !Picture 7.png|align=center! # A wizard will come up, and select next. Enter e for the alias to the E: drive !Picture 8.png|align=center! # Enter E:\ For the path to the directory that contains the contents !Picture 9.png|align=center! # Select Read and Browse permissions !Picture 10.png|align=center! Click Finish on the next window and you are done. The virtual directory should now show up as http:\\eits.shore.mbari.org\e in your web browser. ]]> 3638057 6226084 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > /var/log/runEITS {code}]]> 6258861 3178710 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Added packages bash, perl, and cvsutils using the  [http://www.cygwin.com/setup.exe] utility. h2. Installation notes First, install aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access to moonjelly for this to work. {code} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {code}]]> 3113191 3178709 Install StorView (Host Based). * cygwin http://www.cygwin.com/; ** Added packages bash, perl, and cvsutils using the  [http://www.cygwin.com/setup.exe] utility.]]> 3113190 3670806 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS experiment workflow software installation|EITS:EITS computer workflow software setup]]]> 3638059 3178712 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Added packages bash, perl, and cvsutils using the  [http://www.cygwin.com/setup.exe] utility. h2. Installation notes First, install aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access to moonjelly for this to work. {preformatted} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {code}]]> 3113193 3670807 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS experiment workflow software installation|EITS:EITS computer workflow software setup] [EITS web service installation notes]]]> 3638060 6226089 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp][EITS workflow scripts and cron job installation] h2. h2. [EITS workflow scripts and cron job installation] [EITS web service installation] [EITS RAID directories]\\]]> 6258866 3670809 3638062 3178714 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Added packages bash, perl, and cvsutils using the  [http://www.cygwin.com/setup.exe] utility. h2. Installation notes Install aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts\\ Install EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work.\\ {noformat} First, install {noformat}]]> 3113195 6226087 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS Workflow Setup h2. [EITS computer web service installation] h2.]]> 6258864 3178699 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ * Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} h1. Installing Condor As Execute-Only Node on Windows * Installation is from a .msi file. Just double click to install. * TODO: master setup instructions here * Java setup. \- Download scimark2lib from math.nist.gov/scimark2 and unpack into c:\condor\lib\scrimark2.  \-Edit the condor_config JAVA parameter - add quotes around the executable because "Program files" white space kills JAVA capability test, and add correct path to Windows JAVA.exe. {noformat} JAVA = "C:\Program Files\Java\jdk1.5.0_08\jre\bin\JAVA.EXE" {noformat} h1. Installing Condor as Execute-only Node on Mac OS X See [Condor|this page].]]> 3113180 3178700 3113181 6226107 6258884 3178701 3113182 3670798 3638051 6226113 6258891 3178703 3113184 3670800 website_ !Picture 2.png|align=center! # A wizard will open, click next, then enter the description as _EITS Computer,_ then select Next !Picture 3.png|align=center! # Choose the mbari address 134.*.*.\* , then select Next !Picture 4.png|align=center! # Enter _C:\wwwroot_ for the root path of the home directory !Picture 5.png|align=center! # Select Read and Browse permissions, then select Next and click Finish on the final window. !Picture 6.png|align=center!\\]]> 3638053 6226114 6258892 3178704 3113185 6226111 6258888 3670802 website_ !Picture 2.png|align=center! # A wizard will open, click next, then enter the description as _EITS Computer,_ then select Next !Picture 3.png|align=center! # Choose the mbari address 134.*.*.\* , then select Next !Picture 4.png|align=center! # Enter _C:\wwwroot_ for the root path of the home directory !Picture 5.png|align=center! # Select Read and Browse permissions, then select Next and click Finish on the final window. !Picture 6.png|align=center!\\ h1. Add a Virtual Directory to the RAID to make it visible for http access Select New->VirtualDirectory !Picture 7.png|align=center! #A wizard will come up, and select next. Enter e for the alias to the E: drive !Picture 8.png|align=center! #Enter E:\ For the path to the directory that contains the contents !Picture 9.png|align=center! #Select Read and Browse permissions !Picture 10.png|align=center! Click Finish on the next window and you are done. The virtual directory now shows up as http:\\eits.shore.mbari.org\e ]]> 3638055 3178706 3113187 6226101 6258878 3178692 3113173 6226099 6258876 3178693 3113174 3178694 3113175 6226105 6258882 8388741 8355980 6226106 6258883 19 21 6226103 6258880 8388739 8355978 3178698 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ * Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} h1. Installing Condor As Execute-Only Node on Windows * Installation is from a .msi file. Just double click to install. * TODO: master setup instructions here * Java setup. \- Download scimark2lib from math.nist.gov/scimark2 and unpack into c:\condor\lib\scrimark2.  \-Edit the condor_config JAVA parameter - add quotes around the executable because "Program files" white space kills JAVA capability test, and add correct path to Windows JAVA.exe. {noformat} JAVA = "C:\Program Files\Java\jdk1.5.0_08\jre\bin\JAVA.EXE" {noformat}]]> 3113179 6226060 6258836 6226059 6258835 3178753 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ \\ \\ \\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}\\ \\ \\ \\ Download the condor-6.8.8-winnt50-x80.msi installer from condor web site. To get this file, first need to accept disclaimer and give them your email, then you will get access to the installer. \\ Step 1 Step 2, join the nanomia central manager Step 3, keep all defaults. This machine is not meant to run jobs, just to submit them, which is the default. \\ Step 4, leave blank. Since this machine is behind the firewall and not using MBARI-wide UID. Step 5. enter mail.mbari.org for mail server and dcline@mbari.org for email address of administrator. \\ Step 6. keep default Step 7. keep defaults, except change Hosts with Write access to \*.shore.mbari.org Step 8. keep default. Step 9. Select Install. \\ To configure Internet Connection Firewall for IIS From the Start menu, click Control Panel. Double-click Network Connections. Right-click the Local Area Connection, and click Properties. Click the Advanced tab. If you do not want to use the Internet Connection Firewall, make sure the Protect my computer and network by limiting or preventing access to this computer from the Internet check box is disabled, and click OK. If you do want to use the Internet Connection Firewall, make sure the Protect my computer and network by limiting or preventing access to this computer from the Internet check box is enabled, and click Settings. On the Services tab, enable a service to which you want to allow access to clients. In the Service Settings dialog box that appears after enabling a service, do one of the following: If you are enabling a service on the same computer on which you are working, the correct computer name is already filled in. Click OK. If you are enabling a service on a different computer on your network, type the name or IP address of the computer hosting the service you are enabling, and click OK. Repeat steps 7 and 8 until all the services you want accessible to clients are enabled. ]]> 3113234 6226065 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > /var/log/runEITS {code}]]> 6258841 3178751 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ \\ \\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}\\ \\ \\ Download the condor-6.8.8-winnt50-x80.msi installer from condor web site. To get this file, first need to accept disclaimer and give them your email, then you will get access to the installer. \\ Step 1 Step 2, join the nanomia central manager Step 3, keep all defaults. This machine is not meant to run jobs, just to submit them, which is the default. \\ Step 4, leave blank. Since this machine is behind the firewall and not using MBARI-wide UID. Step 5. enter mail.mbari.org for mail server and dcline@mbari.org for email address of administrator. \\ Step 6. keep default Step 7. keep defaults, except change Hosts with Write access to \*.shore.mbari.org Step 8. keep default. Step 9. Select Install.\\]]> 3113232 6226051 6258827 3178741 3113222 6226054 6258830 3178740 3113221 3178739 3113220 6226056 6258832 3178745 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from http://java.sun.com/javase/downloads/index.jsp h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ \\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}\\ \\ Download the condor-6.8.8-winnt50-x80.msi installer from condor web site. To get this file, first need to accept disclaimer and give them your email, then you will get access to the installer. \\ Step 1 Step 2, join the nanomia central manager Step 3, keep all defaults. This machine is not meant to run jobs, just to submit them, which is the default. \\ Step 4, leave blank. Since this machine is behind the firewall and not using MBARI-wide UID. Step 5. enter mail.mbari.org for mail server and dcline@mbari.org for email address of administrator.\\]]> 3113226 6226058 6258834 6226057 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS computer directory and workflow configuration|EITS computer directory and workflow configuration] h2. h2. [EITS computer web service installation] h2.]]> 6258833 3178743 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}\\ Download the condor-6.8.8-winnt50-x80.msi installer from condor web site. To get this file, first need to accept disclaimer and give them your email, then you will get access to the installer.\\ Step 1 Step 2, join the nanomia central manager Step 3, keep all defaults. This machine is not meant to run jobs, just to submit them, which is the default.\\]]> 3113224 6226075 6258852 6226076 6258853 3178734 3113215 6226077 6258854 6226078 6258855 3178732 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}]]> 3113213 3178737 3113218 6226080 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS computer directory and workflow configuration|EITS RAID directories] h2. h2. [EITS computer web service installation] h2.]]> 6258857 6226081 website_ !Picture 2.png|align=center! # A wizard will open, click next, then enter the description as _EITS Computer,_ then select Next !Picture 3.png|align=center! # Choose the mbari address 134.*.*.\* , then select Next !Picture 4.png|align=center! # Enter _C:\wwwroot_ for the root path of the home directory !Picture 5.png|align=center! # Select Read and Browse permissions, then select Next and click Finish on the final window. !Picture 6.png|align=center!\\ h1. Add a Virtual Directory to the RAID to make it visible for http access # Login as *Administrator.* # In the "Manage Your Server" window that opens at login, select _Manage this application Server_ !Picture 1.png|align=center! # Select New->VirtualDirectory !Picture 7.png|align=center! # A wizard will come up, and select next. Enter e for the alias to the E: drive !Picture 8.png|align=center! # Enter E:\ For the path to the directory that contains the contents !Picture 9.png|align=center! # Select Read and Browse permissions !Picture 10.png|align=center! Click Finish on the next window and you are done. The virtual directory should now show up as http:\\eits.shore.mbari.org\e in your web browser. ]]> 6258858 6226069 6258845 6226070 6258846 3178730 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}]]> 3113211 6226074 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS computer directory and workflow configuration|EITS computer directory] h2. h2. [EITS computer web service installation] h2.]]> 6258851 3178728 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. h2. Installation notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}]]> 3113209 6226162 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 6258940 3178656 3113136 6226161 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > /var/log/runEITS {code}]]> 6258939 9404614 \\ | Path to the mask image. Change this to change the mask used. Do not specify an absolute path to the file, but rather just a filename.  Put this same file in the user "erika" \~/workflow directory and it will then be used in the workflow. | | \--mbari-save-non-interesting-events | Saves non interesting events in addition to interesting events. The result of setting this option is to save more events which can lead to more false detections. To reduce the number of events generated, simply remove this option. \\ | | \--mbari-min-event-area=  \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | h2. How to change the options \\ # Login into EITS using a Remote Desktop Connection, or equivalent.  Use the user name:  erika,  and ask Erika for the password. # Once logged in, click the cygwin icon (click to enlarge) !EITSChangeAVEDOptions1.png|thumbnail! # In the cygwin window set the xemacs editor as your default editor and edit the crontab file with the following: {code} $ export EDITOR='xemacs' $ crontab -e {code} This will open the xemacs editor with the contents of the crontab file.  Change the options designated by the environment variable MBARIVISION_OPTIONS as this variable stores all the AVED processing options. (click to enlarge) !EITSChangeAVEDOptions2.png|thumbnail,width=200,height=162! # After changes are made, save the changes and exit xemacs to implement the changes and you're done \!\! (click to enlarge) !EITSChangeAVEDOptions3.png|thumbnail!]]> 9371865 3178658 3113138 9404616   \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | h2. # Login into EITS using a Remote Desktop Connection, or equivalent.  Use the user name:  erika,  and ask Erika for the password. # Once logged in, click the cygwin icon (click to enlarge) !EITSChangeAVEDOptions1.png|thumbnail! # In the cygwin window set the xemacs editor as your default editor and edit the crontab file with the following: {code} $ export EDITOR='xemacs' $ crontab -e {code} This will open the xemacs editor with the contents of the crontab file.  # Change the options designated by the environment variable MBARIVISION_OPTIONS as this variable stores all the AVED processing options. (click to enlarge) !EITSChangeAVEDOptions2.png|thumbnail,width=200,height=162! # After changes are made, save the changes and exit xemacs to implement the changes and you're done \!\! (click to enlarge) !EITSChangeAVEDOptions3.png|thumbnail! h3. How to change the video mask If changes to the video mask are required, simply replace the videomask.jpg file in the \~/workflow directory with the one to use in the workflow. ]]> 9371867 3178652 3113131 9404618 9371869 3178653 Install StorView (Host Based). * cygwin [http://www.cygwin.com/. ]; ** Added packages bash, perl, and cvsutils using the  [http://www.cygwin.com/setup.exe] utility.]]> 3113132 9404619   \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | h2. # Login into EITS using a Remote Desktop Connection, or equivalent.  Use the user name:  erika,  and ask Erika for the password. # Once logged in, click the cygwin icon (click to enlarge) !EITSChangeAVEDOptions1.png|thumbnail! # In the cygwin window set the xemacs editor as your default editor and edit the crontab file with the following: {code} $ export EDITOR='xemacs' $ crontab -e {code} This will open the xemacs editor with the contents of the crontab file.  # Change the options designated by the environment variable MBARIVISION_OPTIONS as this variable stores all the AVED processing options. (click to enlarge) !EITSChangeAVEDOptions2.png|thumbnail,width=200,height=162! # After changes are made, save the changes and exit xemacs to implement the changes and you're done \!\! (click to enlarge) !EITSChangeAVEDOptions3.png|thumbnail! h3. How to change the video mask {anchor:videomask} If changes to the video mask are required, simply replace the videomask.jpg file in the \~/workflow directory with the one to use in the workflow. ]]> 9371870 9404621 9371872 6226177 6258956 6226178 6258957 3178640 Install StorView (Host Based).]]> 3113118 6226175 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat}\\ \\ \\ \\ h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat} \[root@nanomia condor\]# rpm \-qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: \* Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} \* Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File \* If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, then skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} \* Otherwise, forward your mail to a legitimate MBARI user, e.g. dcline@mbari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 6258954 3178641 Install StorView (Host Based). * cygwin http://www.cygwin.com/.  ** Added packages bash, perl, and cvsutils using the  http://www.cygwin.com/setup.exe utility.]]> 3113119 6226176 6258955 6226173 6258952 3178635 3113113 6226174 6258953 6226171 6258950 3178638 Install StorView (Host Based)]]> 3113116 6226169 6258948 3178631 3113107 6226167 6258946 3178634 3113111 6226166 6258945 3178628 3113105 6226163 6258941 6226164 6258942 3178689 3113170 3178687 3113167 3178686 3113166 3178685 3113165 3178683 3113163 3178681 3113161 3178680 3113160 6226116 6258894 6226115 6258893 3178666 3113146 3178664 3113144 3178662 3113142 3178660 3113140 8388633 8355866 8388634 8355867 8388637 Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D -u erika {noformat} You will be prompted for your password. Change this to the same password you use to login to EITS. This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. {noformat} chmod a+rwx /var/log/cron.log {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running.]]> 8355870 8388636 Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg! # Now start the rsyncd service: {noformat} net start rsyncd {noformat}]]> 8355869 8388666 8355901 3178619 3113095 3178625 3113101 3178626 3113102 8388669 8355904 3178623 3113099 8388670 8355905 8388648 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 8355881 11273008 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. Experiment software * [EITS workflow scripts and cron job installation] * [EITS web service] * [EITS RAID directories] * [EITS cron setup] * [EITS rsync setup] * [EITS streaming setup|EITS:EITS streaming setup]]]> 11240268 11273010 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. Experiment software * [EITS workflow scripts and cron job installation] * [EITS web service] * [EITS RAID directories] * [EITS cron setup] * [EITS rsync setup] * [EITS streaming setup|EITS:EITS streaming setup]]]> 11240270 6226042 6258816 6226041 6258815 6226040 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS workflow software installation|EITS:EITS computer workflow software setup] h2. [EITS web service installation]]]> 6258814 6226039 6258813 6226049 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS computer directory and workflow configuration|EITS computer directory and workflow configuration] h2. [] [] h2. [EITS computer web service installation] h2.]]> 6258825 6226048 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS computer directory and workflow configuration|EITS computer directory and workflow configuration] h2. [EITS web service installation]]]> 6258824 6226046 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 6258821 6226045 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 6258820 6226043 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS workflow software installation|EITS computer directory and workflow configuration] h2. [EITS web service installation]]]> 6258817 3178557 3113025 3178558 3113026 8388738 8355977 3670542 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user Administrator. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the user for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  Now cron.d should be listed as a service. Open the Services Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start, *bold* note that only one cron service *bold* is allowed to run under cygin. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637790 3670545 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the user for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  Now cron.d should be listed as a service. Open the Services Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start, *bold* note that only one cron service *bold* is allowed to run under cygin. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637793 3670543 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user Administrator. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the user for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  Now cron.d should be listed as a service. Open the Services Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start, *bold* note that only one cron service *bold* is allowed to run under cygin. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637791 3670533 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} * h2. Rsyncd setup Install the rsyncd daemon as user Administrator. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the user for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  Now cron.d should be listed as a service. Open the Services Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start, *bold* note that only one cron service *bold* is allowed to run under cygin. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637781 3670532 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} * h2. Rsyncd setup Install the rsyncd daemon as user Administrator. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the user for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  Now cron.d should be listed as a service. Open the Services Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start, *bold* note that only one cron service *bold* is allowed to run under cygin. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637780 3670538 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} * h2. Rsyncd setup Install the rsyncd daemon as user Administrator. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the user for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  Now cron.d should be listed as a service. Open the Services Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start, *bold* note that only one cron service *bold* is allowed to run under cygin. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637786 3670536 3637784 3670535 3637783 3670557 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # As the user who will be running jobs, create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file: {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637805 3670555 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # As the user who will be running jobs, create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637803 3178978 3113473 3670561 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file {noformat} MAILTO="dcline@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts:/home/Administrator/beoscripts:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637809 3670559 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # As the user who will be running jobs, create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file {noformat} MAILTO="dcline@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts:/home/Administrator/beoscripts:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637807 7798819 \\ | Path to the mask image. Change this to change the mask used. Do not specify an absolute path to the file, but rather just a filename.  Put this same file in the user "erika" \~/workflow directory and it will then be used in the workflow. | | \--mbari-save-non-interesting-events | Saves non interesting events in addition to interesting events. The result of setting this option is to save more events which can lead to more false detections. To reduce the number of events generated, simply remove this option. \\ | | \--mbari-min-event-area=  \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | h2. How to change the options \\ # Login into EITS using a Remote Desktop Connection, or equivalent.  Use the user name:  erika,  and ask Erika for the password. # Once logged in, click the cygwin icon (click to enlarge) !EITSChangeAVEDOptions1.png|thumbnail! # In the cygwin window set the xemacs editor as your default editor and edit the crontab file with the following: {code} $ export EDITOR='xemacs' $ crontab -e {code} This will open the xemacs editor with the contents of the crontab file.  Change the options designated by the environment variable MBARIVISION_OPTIONS as this variable stores all the AVED processing options. (click to enlarge) !EITSChangeAVEDOptions2.png|thumbnail,width=200,height=162! # After changes are made, save the changes and exit xemacs to implement the changes and you're done \!\! (click to enlarge) !EITSChangeAVEDOptions3.png|thumbnail!]]> 7766055 3670549 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # As the user who will be running jobs, create a con service for the user: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  This cron service should now come up as a service. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637797 7798820 7766056 3670547 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Next, create a con service for the user that will be processing jobs. {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  This cron service should now come up as a service. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637795 3670548 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # As the user who will be running jobs, create a con service for the user: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  This cron service should now come up as a service. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637796 3670553 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # As the user who will be running jobs, create a con service for the user: {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} You will be prompt to enter the user password.  This cron service should now come up as a service. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637801 3670551 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # As the user who will be running jobs, create a con service for the user: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} You will be prompt to enter the user password.  This cron service should now come up as a service. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/dcline/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637799 3178987 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat}\\ \\ \\ h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat} \[root@nanomia condor\]# rpm \-qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: \* Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} \* Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File \* If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} \* Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 3113482 3178991 3113486 7798818 7766054 3670576 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file {noformat} MAILTO="dcline@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637826 3178992 3113487 3178979 3113474 3670563 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron.\\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file {noformat} MAILTO="dcline@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts:/home/Administrator/beoscripts:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637811 3178981 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} \[root@nanomia condor\]# cd /opt/condor-6.8.4/etc/examples \[root@nanomia condor\]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln \-s /etc/init.d/condor /etc/rc2.d/S100condor ln \-s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} \[root@nanomia condor\]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} \[root@nanomia condor\]# /opt/condor-6.8.4/condor_configure \--type=submit, execute,manager \--central-manager=nanomia.shore.mbari.org \--owner=root \--install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat}  \[root@nanomia condor\]# rpm \-qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: \* Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} \* Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File \* If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org:     dcline@mbari.org {noformat} \* Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org:     dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} \[root@nanomia mail\]/sbin/service sendmail restart {noformat}]]> 3113476 3178983 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} \[root@nanomia condor\]# cd /opt/condor-6.8.4/etc/examples \[root@nanomia condor\]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln \-s /etc/init.d/condor /etc/rc2.d/S100condor ln \-s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} \[root@nanomia condor\]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} \[root@nanomia condor\]# /opt/condor-6.8.4/condor_configure \--type=submit, execute,manager \--central-manager=nanomia.shore.mbari.org \--owner=root \--install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat}  \[root@nanomia condor\]# rpm \-qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: \* Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} \* Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File \* If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} \* Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} \[root@nanomia mail\]/sbin/service sendmail restart {noformat}]]> 3113478 3178985 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln \-s /etc/init.d/condor /etc/rc2.d/S100condor ln \-s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} [root@nanomia condor\]# service condor start {noformat}\\ h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat}  \[root@nanomia condor\]# rpm \-qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: \* Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} \* Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File \* If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} \* Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 3113480 3179004 3113504 3179003 3113503 3179006 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes\\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {panel} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: {noformat} net start rsyncd {noformat}]]> 3113506 3179005 3113505 11829262 11796495 11829264 11796497 11829265 11796498 3178897 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.*.*,10.91.*.* read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the services with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}]]> 3113388 3178895 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.*.*,10.91.*.* read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the services with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}]]> 3113386 3178893 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat}      export CVS=:pserver:dcline@moonjelly:/home/cvs      cvs login      cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat}      export SVN_SSH='ssh \-l dcline'      svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.*.*,10.91.*.* read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the services with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} ]]> 3113384 3178891 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat}      export CVS=:pserver:dcline@moonjelly:/home/cvs      cvs login      cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat}      export SVN_SSH='ssh \-l dcline'      svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following: {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.*.*,10.91.*.* read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the services with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}]]> 3113382 6226423 6259212 3178889 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly      export CVS=:pserver:dcline@moonjelly:/home/cvs      cvs login      cvs co aved/scripts # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna.      export SVN_SSH='ssh \-l dcline'      svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! #  ]]> 3113380 6226424 6259213 3178887 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg!\\ \* Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} . export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} \* Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} \* h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. \* h2. Rsyncd setup Launch cygwin by double-clicking on the desktop icon* !cygwin.jpg!]]> 3113378 3178885 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. * Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg!\\ \* Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} . export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} \* Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} \* h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. \* h2. Rsyncd setup * *Launch cygwin by double-clicking on the desktop icon* !cygwin.jpg!]]> 3113376 3178884 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. * Launch cygwin by double-clicking on the desktop icon* !cygwin.jpg!\\ \* Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} . export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} \* Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} \* h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. \* h2. Rsyncd setup *Launch cygwin by double-clicking on the desktop icon* !cygwin.jpg!]]> 3113375 3670625 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVSROOT=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file {noformat} MAILTO="dcline@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637875 3670623 {code} to {code:xml}{code} #* Change {code:xml} 3637873 3670622 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user dcline. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = dcline gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file {noformat} MAILTO="dcline@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637872 3178907 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup A rsync daemon is used to synchronize the # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: Select the start menu, then Administrative tools, then Services  (click image thumbnail to enlarge): !administrative.jpg|thumbnail,align=center! Next, start the rsync process.  (click image thumbnail to enlarge):  !startrsyncd.jpg|align=center,thumbnail!\\]]> 3113398 3670620 {code} to {code:xml}{code} #* Change {code:xml} 3637870 3178905 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: Select the start menu, then Administrative tools, then Services  (click image thumbnail to enlarge): !administrative.jpg|thumbnail,align=center! Next, start the rsync process.  (click image thumbnail to enlarge):  !startrsyncd.jpg|align=center,thumbnail!]]> 3113396 3670618 {code} to {code:xml}{code}]]> 3637868 3178903 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: Select the start menu, then Administrative tools, then Services: !administrative.jpg|thumbnail,align=center! (click to enlarge) Next, start the rsync process. !startrsyncd.jpg|thumbnail,align=center! (click to enlarge)]]> 3113394 3670616 3637866 3178901 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} #Start the rsyncd service: Select the start menu, then Administrative tools, then Services:]]> 3113392 3178899 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. h2. Rsyncd setup # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}]]> 3113390 3670612 3637862 3178928 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: {noformat} net start rsyncd {noformat} ]]> 3113420 3178929 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {panel} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: {noformat} net start rsyncd {noformat} ]]> 3113421 3178930 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} ## Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {panel} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: {noformat} net start rsyncd {noformat}]]> 3113422 11567106 2010-02-04 12:55:00.217 2010-03-22 06:17:07.827 6979587 6946819 3178926 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {noformat} # Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes [EITSincoming] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = Administrator gid = Administrator list = yes {noformat} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: Select the start menu, then Administrative tools, then Services  (click image thumbnail to enlarge): !administrative.jpg|thumbnail,align=center! Next, start the rsync process.  (click image thumbnail to enlarge):  !startrsyncd.jpg|align=center,thumbnail!\\ \\]]> 3113418 3670631 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These are checked out to the Administrator account. # Login as *Administrator* # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have a valid account on Moonjelly to do this. {noformat} export CVSROOT=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have a valid account on Kahuna to do this. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Login as *Administrator*. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user erika. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = erika gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, switch to the user who will be submitting jobs for processing, and add the following to their crontab file. This presumes the user *erika* will be processing jobs. {noformat} crontab -e {noformat} {noformat} MAILTO="erika@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637881 6979602 \\ | Path to the mask image. Change this to change the mask used. Do not specify an absolute path to the file, but rather just a filename.  Put this same file in the user "erika" \~/workflow directory and it will then be used in the workflow. | | \--mbari-save-non-interesting-events | Saves non interesting events in addition to interesting events. The result of setting this option is to save more events which can lead to more false detections. To reduce the number of events generated, simply remove this option.\\ | | \--mbari-min-event-area=  \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | \\ \\ \\]]> 6946834 3670633 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These are checked out to the Administrator account. # Login as *Administrator* # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have a valid account on Moonjelly to do this. {noformat} export CVSROOT=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have a valid account on Kahuna to do this. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note}  Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Login as *Administrator*. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user erika. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = erika gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, switch to the user who will be submitting jobs for processing, and add the following to their crontab file. This presumes the user *erika* will be processing jobs. {noformat} crontab -e {noformat} {noformat} MAILTO="erika@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637882 3670627 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVSROOT=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user erika. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = erika gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file {noformat} MAILTO="erika@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637877 6979595 6946827 3670630 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These are checked out to the Administrator account. # Login as *Administrator* # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have a valid account on Moonjelly to do this. {noformat} export CVSROOT=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have a valid account on Kahuna to do this. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Login as *Administrator*. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user erika. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = erika gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, switch to the user who will be submitting jobs for processing, and add the following to their crontab file. This presumes the user *erika* will be processing jobs.add jobs using the crontab command: {noformat} crontab -e {noformat} {noformat} MAILTO="erika@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637880 3670629 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These are checked out to the Administrator account. # Login as *Administrator* # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have a valid account on Moonjelly to do this. {noformat} export CVSROOT=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have a valid account on Kahuna to do this. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Login as *Administrator*. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user erika. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = erika gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next, switch to the user who will be submitting jobs for processing, and add the following to their crontab file. This presumes the user *erika* will be processing jobs. {noformat} MAILTO="erika@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637879 6979607 \\ | Path to the mask image. Change this to change the mask used. Do not specify an absolute path to the file, but rather just a filename.  Put this same file in the user "erika" \~/workflow directory and it will then be used in the workflow. | | \--mbari-save-non-interesting-events | Saves non interesting events in addition to interesting events. The result of setting this option is to save more events which can lead to more false detections. To reduce the number of events generated, simply remove this option. \\ | | \--mbari-min-event-area=  \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | h2. How to change the options \\ # Login into EITS using a Remote Desktop Connection, or equivalent.  Use the user name:  erika,  and ask Erika for the password. # Once logged in, click the cygwin icon (click to enlarge) !EITSChangeAVEDOptions1.png|thumbnail! # In the cygwin window set the xemacs editor as your default editor and edit the crontab file with the following {info:title=Useful Information} notepad and wordpad do not work for this so your only other option is vi and xemacs is much friendlier - trust me on this. {info} {code} $ export EDITOR='xemacs'$ crontab -e {code} This will open the xemacs editor.  Change the options designated by the environment variable MBARIVISION_OPTIONS as this variable stores all the AVED processing options. (click to enlarge) !EITSChangeAVEDOptions2.png|thumbnail,width=200,height=162! # After changes are made, save the changes and exit xemacs to implement the changes]]> 6946839 6979608 \\ | Path to the mask image. Change this to change the mask used. Do not specify an absolute path to the file, but rather just a filename.  Put this same file in the user "erika" \~/workflow directory and it will then be used in the workflow. | | \--mbari-save-non-interesting-events | Saves non interesting events in addition to interesting events. The result of setting this option is to save more events which can lead to more false detections. To reduce the number of events generated, simply remove this option. \\ | | \--mbari-min-event-area=  \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | h2. How to change the options \\ # Login into EITS using a Remote Desktop Connection, or equivalent.  Use the user name:  erika,  and ask Erika for the password. # Once logged in, click the cygwin icon (click to enlarge) !EITSChangeAVEDOptions1.png|thumbnail! # In the cygwin window set the xemacs editor as your default editor and edit the crontab file with the following {info:title=Useful Information} notepad and wordpad do not work for this so your only other option is vi and xemacs is much friendlier - trust me on this. {info} {code} $ export EDITOR='xemacs' $ crontab -e {code} This will open the xemacs editor with the contents of the crontab file.  Change the options designated by the environment variable MBARIVISION_OPTIONS as this variable stores all the AVED processing options. (click to enlarge) !EITSChangeAVEDOptions2.png|thumbnail,width=200,height=162! # After changes are made, save the changes and exit xemacs to implement the changes and you're done \!\! (click to enlarge) !EITSChangeAVEDOptions3.png|thumbnail!]]> 6946840 6979604 \\ | Path to the mask image. Change this to change the mask used. Do not specify an absolute path to the file, but rather just a filename.  Put this same file in the user "erika" \~/workflow directory and it will then be used in the workflow. | | \--mbari-save-non-interesting-events | Saves non interesting events in addition to interesting events. The result of setting this option is to save more events which can lead to more false detections. To reduce the number of events generated, simply remove this option. \\ | | \--mbari-min-event-area=  \\ | The minimum area an event must be to be candidate. \\ | | \--mbari-max-event-area=  | The maximum area an event can be, to be candidate  \\ | | \--rescale-input=x | Rescale input frames to fixed dims. To reduce the size of the input frames processed set this option. Take care to keep the aspect ratio the same as the original frame. The effect of changing this option is to speed up processing.  {color:#ff0000}Important - this will change the size of the output frames generated. Any subsequent actions that use the AVED output frames, like generating the mpeg results of the output will also be reduced resulting in a rescaled mpeg clip.{color}\\ | h2. \\ How to change the options \\ # Login into EITS using a Remote Desktop Connection, or equivalent.  Use the user name:  erika  and ask Erika for the password. # Once logged in, click the cygwin icon (click to enlarge) !EITSChangeAVEDOptions1.png|thumbnail! # In the cygwin window set the xemacs editor as your default editor and edit the crontab file with the following {info:title=Useful Information} notepad and wordpad do not work for this so your only other option is vi and xemacs is much friendlier {info} {code} $ export EDITOR='xemacs'$ crontab -e {code} This will open the xemacs editor.  Change the options designated by the environment variable MBARIVISION_OPTIONS as this variable stores all the AVED processing options. (click to enlarge) !EITSChangeAVEDOptions2.png|thumbnail,width=200,height=162! # After changes are made, save the changes and exit xemacs to implement the changes]]> 6946836 6979605 6946837 3670647 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These are checked out to the Administrator account. # Login as *Administrator* # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have a valid account on Moonjelly to do this. {noformat} export CVSROOT=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have a valid account on Kahuna to do this. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://dcline@kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Login as *Administrator*. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user erika. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = erika gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, switch to the user who will be submitting jobs for processing, and add the following to their crontab file. This presumes the user *erika* will be processing jobs. {noformat} crontab -e {noformat} {noformat} MAILTO="erika@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637896 3670650 {code} to {code:xml}{code} #* Change {code:xml} 3637900 3178837 3113325 3178838 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ \* Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} \* Install condor service script to execute condor on bootup {noformat} \[root@nanomia condor\]# cd /opt/condor-6.8.4/etc/examples \[root@nanomia condor\]# cp condor.boot /etc/init.d/condor {noformat} \* Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add . /etc/profile.d/condor.sh \*before\* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} \* Add soft links to the condor startup script {noformat} ln \-s /etc/init.d/condor /etc/rc2.d/S100condor ln \-s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} \* Start the condor service {noformat} \[root@nanomia condor\]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} \[root@nanomia condor\]# /opt/condor-6.8.4/condor_configure \--type=submit, execute,manager \--central-manager=nanomia.shore.mbari.org \--owner=root \--install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat}  \[root@nanomia condor\]# rpm \-qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: \* Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} \* Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File \* If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org:     dcline@mbari.org {noformat} \* Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org:     dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} \[root@nanomia mail\]/sbin/service sendmail restart {noformat}]]> 3113327 3178850 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment software installation notes Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat} Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default allow this node to submit jobs. \\ \\]]> 3113339 3178852 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment software installation notes h3. Check-out workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts \\ \\ \\ \\ \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow  {noformat} Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default allow this node to submit jobs. \\ \\ Install sendmail from [http://www.indigostar.com/]. Keeping all defaults for installation.]]> 3113341 3178853 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment software installation notes h3. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} h3. Workflow scripts Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default allow this node to submit jobs. \\ \\ Install sendmail from [http://www.indigostar.com/]. Keeping all defaults for installation.]]> 3113342 3178856 3113345 3178855 3113344 3178858 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment software installation notes h3. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} h3. Workflow scripts Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default allow this node to submit jobs. \\ \\]]> 3113347 3670699 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These are checked out to the Administrator account. # Login as *Administrator* # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have a valid account on Moonjelly to do this. {noformat} export CVSROOT=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have a valid account on Kahuna to do this. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://dcline@kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data with a local file system. This rsync process is used in the cron job to initiate workflow processing. # Login as *Administrator*. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user erika. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = erika gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. # Now that the service is started, switch to the user who will be submitting jobs for processing, and add the following to their crontab file. This presumes the user *erika* will be processing jobs. {noformat} crontab -e {noformat} {noformat} MAILTO="erika@mbari.org" PATH=/home/Administrator/workflow:/home/Administrator/aved/scripts: /home/Administrator/beoscripts:/condor/bin:/usr/bin:/usr/sbin MBARIVISION_OPTIONS='--mbari-save-non-interesting-events --mbari-tracking-mode=BoundingBox --mbari-cache-size=15 --mbari-min-event-area=50 --mbari-max-event-area=10000 --mbari-mask-path=videomask.jpg' # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /home/Administrator/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637950 3178860 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} h3. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default allow this node to submit jobs. \\ \\]]> 3113349 3178862 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default allow this node to submit jobs. \\ \\]]> 3113351 3670704 3637954 3178863 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} . export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default allow this node to submit jobs. \\ \\]]> 3113352 3670712 3637965 3670714 3637967 3178874 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} . export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. \\ \\]]> 3113364 3670716 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Condor setup As user *Administrator*, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory e:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in e:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in e:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above can be owned by any user in the Administrator group. {note} * h2. Rsyncd setup Install the rsyncd daemon as user *Administrator*. A rsync daemon is used to synchronize the incoming EITS data in e:\EITSincoming with a local file system e:\EITSraw. This rsync process is used in the EITS scripts to initiate workflow processing. # Login as *Administrator*. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following. This assumes the incoming data is in the EITSincoming directory and owned by the user erika. {panel} \# Allows all hosts in the mbari domain network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/e/EITSincoming comment = Incoming data from the EITS instrument uid = erika gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat} This rsync service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail! # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user *Administrator* first, grant rights to users to install cron jobs. The following assumes all users are in the Administrators group. # Starting at Control Panel \-> Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg|thumbnail!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ {noformat} chmod a+rwx /var/log/cron.log {noformat}\\ \\ # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Login as the user who will be submitting jobs for processing. This presumes the user *erika* will be processing jobs and this user must have valid accounts on the servers Moonjelly and Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. {noformat} export CVSROOT=:pserver:erika@moonjelly:/home/cvs cvs login cvs co aved/scripts aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.   {noformat} export SVN_SSH='ssh \-l erika' svn co svn+ssh://erika@kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} h2. Cron job Now that the service is started, switch to the user who will be submitting jobs for processing, and add the following to their crontab file. This presumes the user *erika* will be processing jobs. {noformat} crontab -e {noformat} {noformat} MAILTO="erika@mbari.org" PATH=/home/erika/workflow:/home/erika/aved/scripts: /home/erika/beoscripts:/condor/bin:/usr/bin:/usr/sbin MBARIVISION_OPTIONS='--mbari-save-non-interesting-events --mbari-tracking-mode=BoundingBox --mbari-cache-size=15 --mbari-min-event-area=50 --mbari-max-event-area=10000 --mbari-mask-path=videomask.jpg' # Every 5 minutes run the EITS script runEITS # 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637969 3178879 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. * Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} . export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} * Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup ]]> 3113370 3670719 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. [EITS experiment workflow software installation|EITS:EITS computer workflow software setup] * h2. h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Login as the user who will be submitting jobs for processing. This presumes the user *erika* will be processing jobs and this user must have valid accounts on the servers Moonjelly and Kahuna. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. {noformat} export CVSROOT=:pserver:erika@moonjelly:/home/cvs cvs login cvs co aved/scripts aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.   {noformat} export SVN_SSH='ssh \-l erika' svn co svn+ssh://erika@kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} h2. Cron job Now that the service is started, switch to the user who will be submitting jobs for processing, and add the following to their crontab file. This presumes the user *erika* will be processing jobs. {noformat} crontab -e {noformat} {noformat} MAILTO="erika@mbari.org" PATH=/home/erika/workflow:/home/erika/aved/scripts: /home/erika/beoscripts:/condor/bin:/usr/bin:/usr/sbin MBARIVISION_OPTIONS='--mbari-save-non-interesting-events --mbari-tracking-mode=BoundingBox --mbari-cache-size=15 --mbari-min-event-area=50 --mbari-max-event-area=10000 --mbari-mask-path=videomask.jpg' # Every 5 minutes run the EITS script runEITS # 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {noformat}]]> 3637972 3178881 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. * {color:#003366}{*}Launch cygwin by double-clicking on the desktop icon{*}{color} !cygwin.jpg!\\ * Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} . export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} * Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup {color:#003366}{*}Launch cygwin by double-clicking on the desktop icon{*}{color} !cygwin.jpg!]]> 3113372 3670721 3637974 3178882 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. * {*}Launch cygwin by double-clicking on the desktop icon{*}{color} !cygwin.jpg!\\ * Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} . export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat} * Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup {*}Launch cygwin by double-clicking on the desktop icon{*}{color} !cygwin.jpg!]]> 3113373 3670729 3637982 3178762 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ * Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} ]]> 3113245 3178761 3113244 950274 toConcept -> LinkValue. Currently considered associations are: * *"identity-reference | self | "* * *"saliency | self | "* * "start-timecode | self | " h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| ]]> 917506 3178760 e.g. dcline@mbari {noformat} h2. Installing Condor as a service on Linux \\ * Create condor.sh file in /etc/profile.d then add the following to it: {noformat} CONDOR_ROOT=/opt/condor-6.8.4 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config {noformat} * Install condor service script to execute condor on bootup {noformat} [root@nanomia condor]# cd /opt/condor-6.8.4/etc/examples [root@nanomia condor]# cp condor.boot /etc/init.d/condor {noformat} * Edit condor service script replacing MASTER line {noformat} MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add . /etc/profile.d/condor.sh *before* the line MASTER {noformat} . /etc/profile.d/condor.sh MASTER=$CONDOR_ROOT/sbin/condor_master {noformat} * Add soft links to the condor startup script {noformat} ln -s /etc/init.d/condor /etc/rc2.d/S100condor ln -s /etc/init.d/condor /etc/rc2.d/K100condor {noformat} * Start the condor service {noformat} [root@nanomia condor]# service condor start {noformat} h1. Installing Condor As Master Node on Linux     The instructions for installing as a master expect when runing the condor_configure script you need to add the role manager, e.g.: {noformat} [root@nanomia condor]# /opt/condor-6.8.4/condor_configure --type=submit, execute,manager --central-manager=nanomia.shore.mbari.org --owner=root --install-dir=/opt/condor-6.8.4 {noformat} h1. MBARI Mail setup for Condor on Linux Condor sends email on job completion, or failure. All Linux server swith Condor and sendmail installed, can be easily configured to send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first* {noformat} [root@nanomia condor]# rpm -qf sendmail-cf sendmail-cf-8.13.1-2 {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, than skip this {noformat} aved@nanomia.shore.mbari.org: dcline@mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dclinembari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat} h1. Installing Condor As Execute-Only Node on Windows * Installation is from a .msi file. Just double click to install. * TODO: master setup instructions here * Java setup. \- Download scimark2lib from math.nist.gov/scimark2 and unpack into c:\condor\lib\scrimark2.  \-Edit the condor_config JAVA parameter - add quotes around the executable because "Program files" white space kills JAVA capability test, and add correct path to Windows JAVA.exe. {noformat} JAVA = "C:\Program Files\Java\jdk1.5.0_08\jre\bin\JAVA.EXE" {noformat} h1. Installing Condor as Execute-only Node on Mac OS X See [this page|Condor].]]> 3113243 950273 toConcept -> LinkValue. Currently considered associations are: * *"identity-reference | self | "* * *"saliency | self | "* * "start-timecode | self | " h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| ]]> 917505 3670728 # 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw]]> 3637981 3670725 3637978 3670726 # 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw]]> 3637979 3178757 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ \\ \\ \\ \\ \\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}\\ \\ \\ \\ \\ \\ Download the condor-6.8.8-winnt50-x80.msi installer from condor web site. To get this file, first need to accept disclaimer and give them your email, then you will get access to the installer. \\ Step 1 Step 2, join the nanomia central manager Step 3, Select Always run jobs and never suspend this. This machine is intended to run jobs - only to submit them, but we will enable it so it shows up in the pool. If its in the poos we can use as a resource in case more resources are needed. Step 4, enter shore.mbari.org Step 5. enter mail.mbari.org for SMTP server and dcline@mbari.org for email address of administrator. \\ Step 6. keep default which should be something like C:\Program Files\Java\jdk1.6.0_04\bin\JAVA.EXE Step 7. Change read access and Write access to \*.shore.mbari.org Step 8. keep default. Step 9. Select Install. Step 10. Finish \\ To configure Internet Connection Firewall for IIS From the Start menu, click Control Panel. Double-click Network Connections. Right-click the Local Area Connection, and click Properties. Click the Advanced tab. If you do not want to use the Internet Connection Firewall, make sure the Protect my computer and network by limiting or preventing access to this computer from the Internet check box is disabled, and click OK. If you do want to use the Internet Connection Firewall, make sure the Protect my computer and network by limiting or preventing access to this computer from the Internet check box is enabled, and click Settings. On the Services tab, enable a service to which you want to allow access to clients. In the Service Settings dialog box that appears after enabling a service, do one of the following: If you are enabling a service on the same computer on which you are working, the correct computer name is already filled in. Click OK. If you are enabling a service on a different computer on your network, type the name or IP address of the computer hosting the service you are enabling, and click OK. Repeat steps 7 and 8 until all the services you want accessible to clients are enabled. ]]> 3113238 3670723 3637976 3178755 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ \\ \\ \\ \\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}\\ \\ \\ \\ \\ Download the condor-6.8.8-winnt50-x80.msi installer from condor web site. To get this file, first need to accept disclaimer and give them your email, then you will get access to the installer. \\ Step 1 Step 2, join the nanomia central manager Step 3, Select Always run jobs and never suspend this. This machine is intended to run jobs - only to submit them, but we will enable it so it shows up in the pool. If its in the poos we can use as a resource in case more resources are needed. Step 4, leave blank. Since this machine is behind the firewall and not using MBARI-wide UID. Step 5. enter mail.mbari.org for mail server and dcline@mbari.org for email address of administrator. \\ Step 6. keep default Step 7. keep defaults, except change Hosts with Write access to \*.shore.mbari.org Step 8. keep default. Step 9. Select Install. \\ To configure Internet Connection Firewall for IIS From the Start menu, click Control Panel. Double-click Network Connections. Right-click the Local Area Connection, and click Properties. Click the Advanced tab. If you do not want to use the Internet Connection Firewall, make sure the Protect my computer and network by limiting or preventing access to this computer from the Internet check box is disabled, and click OK. If you do want to use the Internet Connection Firewall, make sure the Protect my computer and network by limiting or preventing access to this computer from the Internet check box is enabled, and click Settings. On the Services tab, enable a service to which you want to allow access to clients. In the Service Settings dialog box that appears after enabling a service, do one of the following: If you are enabling a service on the same computer on which you are working, the correct computer name is already filled in. Click OK. If you are enabling a service on a different computer on your network, type the name or IP address of the computer hosting the service you are enabling, and click OK. Repeat steps 7 and 8 until all the services you want accessible to clients are enabled. ]]> 3113236 9404758 9372010 3178770 3113253 8388939 8356188 3670738 Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con servicecygrunsrv -I cron -p /usr/sbin/cron -a -D This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  \\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. \\ chmod a+rwx /var/log/cron.log \\ \\ # Next, start the service with:cygrunsrv -S cron If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running. h2.]]> 3637991 3178769 3113252 3178768 3113251 3178766 3113249 3670734 Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered : !rsync.jpg|thumbnail,width=32,height=32! # Now start the rsyncd service: {noformat} net start rsyncd {noformat}]]> 3637987 3178765 3113248 3670731 3637984 9404759 9372011 3178763 3113246 3670746 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {code}]]> 3637999 3670745 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {code}]]> 3637998 3178778 3113261 3670744 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {code}]]> 3637997 3178776 3113259 3178773 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat}\\ Download the condor-6.8.8 from http://parrot.cs.wisc.edu/. Get the condor-6.8.8-winnt50-x80.msi installer from condor web site. To get this file, first need to accept disclaimer and give them your email, company info etc., then you will get access to the installer site right away. \\ Step 1\\ Step 2, join the nanomia central manager Step 3, Select Always run jobs and never suspend this. This machine is intended to run jobs - only to submit them, but we will enable it so it shows up in the pool. If its in the poos we can use as a resource in case more resources are needed. Step 4, enter shore.mbari.org Step 5. enter mail.mbari.org for SMTP server and dcline@mbari.org for email address of administrator. \\ Step 6. keep default which should be something like C:\Program Files\Java\jdk1.6.0_04\bin\JAVA.EXE Step 7. Change read access and Write access to \*.shore.mbari.org Step 8. keep default. Step 9. Select Install. Step 10. Finish \\ To configure Internet Connection Firewall for IIS From the Start menu, click Control Panel. Double-click Network Connections. Right-click the Local Area Connection, and click Properties. Click the Advanced tab. If you do not want to use the Internet Connection Firewall, make sure the Protect my computer and network by limiting or preventing access to this computer from the Internet check box is disabled, and click OK. If you do want to use the Internet Connection Firewall, make sure the Protect my computer and network by limiting or preventing access to this computer from the Internet check box is enabled, and click Settings. On the Services tab, enable a service to which you want to allow access to clients. In the Service Settings dialog box that appears after enabling a service, do one of the following: If you are enabling a service on the same computer on which you are working, the correct computer name is already filled in. Click OK. If you are enabling a service on a different computer on your network, type the name or IP address of the computer hosting the service you are enabling, and click OK. Repeat steps 7 and 8 until all the services you want accessible to clients are enabled. ]]> 3113256 3178774 3113257 3670740 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw {code}]]> 3637993 3178783 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat} Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default allow this node to submit jobs. \\ \\]]> 3113266 3178781 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Add-on packages include: bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS Software Installation Notes Check-out aved script from CVS. I did this using my dcline account on moonjelly. You must have CVS access on Moonjelly for this to work. {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts {noformat}\\ \\ Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. You must have Subversion access on Kahuna for this to work. \\ {noformat} export SVN_SSH='ssh -l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow   {noformat} Install Condor as Execute and Submit node according to instructions [EITS:Condor setup Windows]\\ \\]]> 3113264 3670749 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > /var/log/runEITS {code}]]> 3638002 3178780 3113263 19072038 /view_client-2.0-Any-Java.tar.Z . [root@nanomia condor] tar -zxvf view_client-2.0-Any-Java.tar.Z [root@nanomia condor] tar -xvf view_client.tar {noformat} * Edit make_stats, changing ORGNAME, CONDORADMIN, etc. to reflect the installation, then run the installation {noformat} [root@nanomia condor] ./make_stats setup [root@nanomia condor] crontab cronentries {noformat} * The page should be visible [http://nanomia.shore.mbari.org/condor-view-applet/]. h2. MBARI Mail setup Condor can be configured to email to users on job completion, or failure. By default the root user will receive any emails if the condor daemons go awry. The following instructions are to setup the machine to correctly forward the emails. To send mail correctly to the MBARI exchange server, with the following: Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not \*you must install this first\* {noformat} [root@nanomia condor]# yum install sendmail-cf {noformat} h2. The /etc/mail/sendmail.mc File Only a few things must be changed from the default sendmail configuration to work with the MBARI email server: * Add following line - this change allows sendmail to redirect to the MBARI mail server {noformat} define(`SMART_HOST',`mail.mbari.org') {noformat} * Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master. {noformat} dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl {noformat} h2. The /etc/mail/virtusertable File * If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, then skip this {noformat} aved@nanomia.shore.mbari.org: @mbari.org {noformat} * Otherwise, forward your mail to a legitimate MBARI user, e.g. dcline@mbari.org, by adding the following line: {noformat} dcline@nanomia.shore.mbari.org: dcline@mbari.org {noformat} h2. Restart sendmail To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service {noformat} [root@nanomia mail]/sbin/service sendmail restart {noformat}]]> 19039294 3670771 Administrative Tools \-> Local Security Policy-> Local Policies \-> User Rights Assignment Grant rights to the group Administrators for the following items: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # Create a con service {noformat} cygrunsrv -I cron -p /usr/sbin/cron -a -D {noformat} This cron service should now come up as a service in Windows. Check this by launching services. Starting at Start->Control Panel \-> Administrative Tools \-> Services, you should see that the service has been entered:  !cron.jpg!\\ # Open the permission of the cron.log file for all users. This appears to be a bug in the cygwin version of cron. {noformat} chmod a+rwx /var/log/cron.log {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} If the service doesn't start,  *note that only one cron service * is allowed to run under cygin so make sure other cron services are not running.]]> 3638024 580 582 8945951 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding  !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* # Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. # Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. # Launch a cygwin shell by clicking on the Desktop icon   !WMESSetup3.png! # Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} # The service should now show up in the services panel as *eitstreaming*, and from there you can start/stop it.  !WMESSetup4.png!]]> 8913194 9405123 9372391 601 603 599 601 600 602 598 600 596 598 607 609 608 610 605 607 606 608 603 605 604 606 9405122 9372390 9405120 9372388 11830046 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. -For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.- This has been installed as a Condor job on the computer somniosus. See details on Condor installation [here|EITS:Somniosus] for more information.]]> 11797302 577 579 578 580 3179224 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data coming in from the EITS instrument is stored in the directory d:\EITSincoming * AVED processed data is in d:\EITSdata * Archived (raw) data is in d:\EITSdata\archives * All of the directories above are owned by the user Administrator, but allow write access to users in the Adminstrators group.  If any of these file locations change, the rsync and cron configuration files needs to be changed accordingly.{note} \\ \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the parent incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -maxdepth 1 -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the parent processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSdata/ -maxdepth 1 -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSdata/archives \; {noformat}]]> 3113726 3179220 3113722 3179219 3113721 3179221 3113723 21397525 21364757 3179234 3113736 3179230 3113732 3179216 3113718 6226623 website_ !Picture 2.png|align=center! # A wizard will open, click next, then enter the description as _EITS Computer,_ then select Next !Picture 3.png|align=center! # Choose the mbari address 134.*.*.\* , then select Next !Picture 4.png|align=center! # Enter _C:\wwwroot_ for the root path of the home directory !Picture 5.png|align=center! # Select Read and Browse permissions, then select Next and click Finish on the final window. !Picture 6.png|align=center!\\ h1. Add a Virtual Directory to the RAID to make it visible for http access # Login as *Administrator.* # In the "Manage Your Server" window that opens at login, select _Manage this application Server_ !Picture 1.png|align=center! # Select New->VirtualDirectory !Picture 7.png|align=center! # A wizard will come up, and select next. Enter e for the alias to the E: drive !Picture 8.png|align=center! # Enter E:\ For the path to the directory that contains the contents !Picture 9.png|align=center! # Select Read and Browse permissions !Picture 10.png|align=center! Click Finish on the next window and you are done. The virtual directory should now show up as http:\\eits.shore.mbari.org\e in your web browser. ]]> 6259422 3179218 3113720 3179211 3113713 3179213 3113715 3179214 3113716 6226507 6259300 3670526 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/bin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} If you opened the Services Starting at control panel \-> administrative tools \-> services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637774 3179070 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron service (see next). # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup The Cron service is used to start the rsync process, clean up incoming data and log files. {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} {noformat} cygrunsrv -S cron {noformat} ]]> 3113571 3670525 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/bin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} If you opened the Services Starting at control panel \-> administrative tools \-> services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637773 3179068 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup Install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: {noformat} net start rsyncd {noformat}]]> 3113569 3670523 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/bin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} If you opened the Services Starting at control panel \-> administrative tools \-> services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637771 3670530 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} If you opened the Services Starting at control panel \-> administrative tools \-> services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If the service doesn't start, *bold* note that only one cron service *bold* is allowed to run under cygin. # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637778 3179074 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat}]]> 3113575 8946107 8913361 6226513 6259310 3670528 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* Adjust memory quotas for a process #* Create a token object #* Log on as service #* Replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/sbin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} If you opened the Services Starting at control panel \-> administrative tools \-> services, you should see that the service has started: !rsynd.dcline.jpg! # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637776 3179072 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator, install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # Install the rsyncd as a service with the command: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup The Cron service is used to start the rsync process, clean up incoming data and log files. {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} {noformat} cygrunsrv -S cron {noformat}]]> 3113573 3670517 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} \\ \\ \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the parent incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -maxdepth 1 -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday move raw data in the root process directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSprocessed/ -maxdepth 1 -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSraw \; {noformat}]]> 3637765 6226502 6259294 6226503 6259295 6226504 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp][EITS workflow scripts and cron job installation] h2. Experiment software * [EITS workflow scripts and cron job installation] * [EITS web service] * [EITS RAID directories] * [EITS cron setup] * [EITS rsync setup]]]> 6259296 3670521 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} \\ \\ \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron.dcline -p /usr/bin/crontab.exe -a -D -u dcline -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron.dcline {noformat} If you opened the Services Starting at control panel \-> administrative tools \-> services, you should see that the service has started: # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637769 741 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote}{color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color}{quote} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* *Q. Where will we store all the data?* *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* *Q. Where will the EITS computers live?* *Q. What are the requirements for supporting _time-code_? Will we use _time-code_ or _run-time_?* {color:#000099}[~dcline] -> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} {info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April.{info} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 744 6226506 6259299 3670519 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming. *If this directory is changed, change the /etc/rsyncd.conf settings accordingly.* * Data processed by AVED is stored in d:\EITSprocessed. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * Archived (raw) data is in d:\EITSraw. *If this directory is changed, change the crontab runEITS argument accordingly (e.g. using crontab \-e).* * All of the directories above are owned by the user Administrator. {note} \\ \\ \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # Every 5 minutes run the EITS script runEITS 0-59/5 * * * * /cygdrive/d/workflow/runEITS /cygdrive/d/EITSprocessed /cygdrive/d/EITSraw {noformat}]]> 3637767 3179054 3113555 768 771 8946095 8913349 16810144 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. Experiment software * [EITS workflow scripts and cron job installation] * [EITS web service] * [EITS RAID directories] * [EITS cron setup] * [EITS rsync setup] * [EITS streaming setup|EITS:EITS streaming setup]]]> 16777382 3670509 3637756 3670510 3637757 3179052 3113553 770 773 3670507 3637754 769 772 8946098 8913352 3670508 3637755 3179058 3113559 8946092 8913346 3670514 3637762 3179056 3113557 8946093 8913347 765 768 8946094 8913348 3670512 3637760 6226515 6259312 3670502 3637749 8946089 8913341 8946090 qt4j qt4j [0.10,) compile ... ... VARS VARS Repository http://vars.sourceforge.net/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QTX4J in your [ant build script|CLT:Maven At MBARI] or download the jars directly from [here|http://vars.sourceforge.net/maven2/org/mbari/qtx4j/]. If you do download _QTX4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://vars.sourceforge.net/maven2/imagej/imagej/1.37//imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[MBARIX4J|http://vars.sourceforge.net/maven2/org/mbari/mbarix4j/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr4j|http://vars.sourceforge.net/maven2/org/mbari/vcr4j/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana.shore.mbari.org/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana.shore.mbari.org/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] h2. Testing Resources AVED processed data that is used for testing is currently hosted on Nanomia. Here's a few useful links: * EITS test data processed by Ishbel: [http://nanomia.shore.mbari.org/EITS_testing] * Test data with longer clips: [http://nanomia.shore.mbari.org/EITS_testing/RESULTS] * RAID storage for [~brian] mapped to _\\nanomia\RAID\brian_: [http://nanomia.shore.mbari.org/brian] ]]> 8913342 6226517 6259314 3670500 3637747 3670505 3637752 3179049 3113549 3179048 3113548 3670504 3637751 3670492 3637739 722 725 3670494 3637741 3670496 3637743 3670498 3637745 3670497 3637744 6226532 6259329 6226535 6259332 736 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote}{color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color}{quote} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* *Q. Where will we store all the data?* *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* *Q. Where will the EITS computers live?* *Q. What are the requirements for supporting _time-code_? Will we use _time-code_ or _run-time_?* {color:#000099}[~dcline] -> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} {info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April.{info} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 739 735 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote}{color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color}{quote} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* *Q. Where will we store all the data?* *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* *Q. Where will the EITS computers live?* *Q. What are the requirements for supporting _time-code_? Will we use _time-code_ or _run-time_?* {color:#000099}[~dcline] -> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erika] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} {info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April.{info} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 738 734 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote}{color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color}{quote} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* *Q. Where will we store all the data?* *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* *Q. Where will the EITS computers live?* *Q. What are the requirements for supporting _time-code_? Will we use _time-code_ or _run-time_?* {color:#000099}[~dcline] -> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule? Erika forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} {info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April.{info} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 737 733 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote}{color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color}{quote} Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.) Q. Where will we store all the data? Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.) Q. Where will the EITS computers live? Q. What are the requirements for supporting _time-code_? Will we use _time-code_ or _run-time_? {color:#000099}[~dcline] -> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} Q. Need to schedule EITS test for a tank test.Originally wanted to schedule in June; Craig says MARS interface won't be ready. (i.e. no point in testing EITS0. When will we reschedule? Erika forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users. h2. Notes * EITS may be delayed until early April.]]> 736 732 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote}{color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color}{quote} Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.) Q. Where will we store all the data? Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.) Q. Where will the EITS computers live? Q. What are the requirements for supporting _time-code_? Will we use _time-code_ {color:#000099}[~dcline] -> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color}or _run-time_? Q. Need to schedule EITS test for a tank test.Originally wanted to schedule in June; Craig says MARS interface won't be ready. (i.e. no point in testing EITS0. When will we reschedule? Erika forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users. h2. Notes * EITS may be delayed until early April.]]> 735 731 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote}{color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color}{quote} Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.) Q. Where will we store all the data? Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.) Q. Where will the EITS computers live? Q. What are the requirements for supporting _time-code_? Will we use _time-code_ {color:#000099}[~dcline] -> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want.  If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color}or _run-time_? Q. Need to schedule EITS test for a tank test.Originally wanted to schedule in June; Craig says MARS interface won't be ready. (i.e. no point in testing EITS0. When will we reschedule? Erika forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users. h2. Notes * EITS may be delayed until early April.]]> 734 730 To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users. h2. Notes * EITS may be delayed until early April.]]> 733 729 To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users. h2. Notes * EITS may be delayed until early April. ]]> 732 6226549 6259346 728 To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users. h2. Notes * EITS may be delayed until early April. ]]> 731 6226548 6259345 726 729 725 728 724 727 723 726 6226551 6259348 683 686 679 682 1867817 1835053 700 703 699 702 694 697 693 696 3179110 3113611 696 699 3179108 3113609 698 701 697 700 653 656 3179104 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data coming in from the EITS instrument is stored in the directory d:\EITSincoming * AVED processed data is in d:\EITSdata * Archived (raw) data is in d:\EITSdata\archives If any of these file locations change, the rsync and cron configuration files needs to be changed accordingly.{note} \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSdata/archives \; {noformat}]]> 3113605 654 657 651 654 3179106 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data coming in from the EITS instrument is stored in the directory d:\EITSincoming * AVED processed data is in d:\EITSdata * Archived (raw) data is in d:\EITSdata\archives * All of the directories above are owned by the user Administrator, but allow write access to users in the Adminstrators group.  If any of these file locations change, the rsync and cron configuration files needs to be changed accordingly.{note} \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSdata/archives \; {noformat}]]> 3113607 652 655 657 660 3670427 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data coming in from the EITS instrument is stored in the directory d:\EITSincoming * AVED processed data is in d:\EITSprocessed * Archived (raw) data is in d:\EITSraw * All of the directories above are owned by the user Administrator, but allow write access to users in the Adminstrators group.  {color:#990000}{*}If any of these file locations change, the rsync and cron configuration files needs to be changed accordingly{*}{color}. {note} \\ \\ \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the parent incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -maxdepth 1 -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday move raw data in the root process directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSprocessed/ -maxdepth 1 -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSraw \; {noformat}]]> 3637672 3179100 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs.{note} \*****Important to note is the following rsyncd and cron setup assumes the data coming in from the EITS instrument is stored in the directory d:\EITSincoming and the processed and archived raw data is stored in d:\EITSdata and d:\EITSdata\archives respectively. If any of these file locations change, the rsync and cron needs to be changed accordingly.{note} * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSdata/archives \; {noformat}]]> 3113601 658 661 655 658 3670429 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data generated from the EITS instrument is stored in the directory d:\EITSincoming * Data processed by AVED is stored in d:\EITSprocessed * Archived (raw) data is in d:\EITSraw * All of the directories noted above are owned by the user Administrator, but allow write access to users in the Adminstrators group.  {color:#990000}{*}If any of these file locations change, the rsync and cron configuration files needs to be changed accordingly{*}{color}. {note} \\ \\ \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the parent incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -maxdepth 1 -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday move raw data in the root process directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSprocessed/ -maxdepth 1 -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSraw \; {noformat}]]> 3637674 3179102 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data coming in from the EITS instrument is stored in the directory d:\EITSincoming * AVED processed data is in d:\EITSdata * Archived (raw) data is in d:\EITSdata\archives respectively. If any of these file locations change, the rsync and cron needs to be changed accordingly. {note}\\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSdata/archives \; {noformat}]]> 3113603 3670423 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data coming in from the EITS instrument is stored in the directory d:\EITSincoming * AVED processed data is in d:\EITSdata * Archived (raw) data is in d:\EITSdata\archives * All of the directories above are owned by the user Administrator, but allow write access to users in the Adminstrators group.  If any of these file locations change, the rsync and cron configuration files needs to be changed accordingly.{note} \\ \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the parent incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -maxdepth 1 -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the parent processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSdata/ -maxdepth 1 -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSdata/archives \; {noformat}]]> 3637668 3179096 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113597 3670425 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following rsyncd and cron setup assumes * Data coming in from the EITS instrument is stored in the directory d:\EITSincoming * AVED processed data is in d:\EITSdata * Archived (raw) data is in d:\EITSdata\archives * All of the directories above are owned by the user Administrator, but allow write access to users in the Adminstrators group.  If any of these file locations change, the rsync and cron configuration files needs to be changed accordingly. {note} \\ \\ \\ \\ \\ * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the parent incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -maxdepth 1 -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday move raw data in the root process directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSprocesseddata/ -maxdepth 1 -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSdata/archives \; {noformat}]]> 3637670 3179098 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. {note} Important to note is the following assumes the data coming in from the EITS instrument is stored in the directory d:\EITSincoming and the processed and archived raw data is stored in d:\EITSdata and d:\EITSdata\archives respectively. If any of these file locations change, the rsync and cron needs to be changed accordingly. {note} * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/d/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/d/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/d/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/d/EITSdata/archives \; {noformat}]]> 3113599 3179091 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv \-I cron \-p /usr/bin/cron.exe \-a \-D \-u Administrator \-e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv \-S cron {noformat} # Next add the following to the crontab file for the user Administrator {noformat} crontab -e {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113592 649 651 3179092 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv \-I cron \-p /usr/bin/cron.exe \-a \-D \-u Administrator \-e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv \-S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113593 650 652 647 649 3179094 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: #* adjust memory quotas for a process #* create a token process #* log on as service #* replace process level token # To install the cron as a service do this: {noformat} cygrunsrv \-I cron \-p /usr/bin/cron.exe \-a \-D \-u Administrator \-e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv \-S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} MAILTO="dcline@mbari.org" # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113595 648 650 3179089 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: * adjust memory quotas for a process * create a token process * log on as service * replace process level token # To install the cron as a service do this: {noformat} cygrunsrv \-I cron \-p /usr/bin/cron.exe \-a \-D \-u Administrator \-e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv \-S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113590 3179084 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy\-> local policies \-> user rights assignment Grant rights to your domain user for the following item: adjust memory quotas for a process create a token process log on as service replace process level token # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113585 9404952 9372215 9404951 9372214 3179086 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. First you much grant rights for the Administrator: Starting at control panel \-> administrative tools \-> local security policy-> local policies \-> user rights assignment Grant rights to your domain user for the following item: * adjust memory quotas for a process * create a token process * log on as service * replace process level token To install the cron as a service do this: cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" Next, start the service with: cygrunsrv -S cron # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113587 3179080 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat}\\ # {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113581 662 665 661 664 9404955 9372218 3179082 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # Next add the following to the crontab file for the user Administrator {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113583 660 663 9404958 9372221 659 662 3179075 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ -type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; ]]> 3113576 665 668 9404959 9372222 3179078 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ -type f -ctime +7 -exec /bin/rm -f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ \-type f -ctime +7 -exec /bin/mv -f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113579 3179077 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, perl, subversion, openssh, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. EITS experiment workflow software installation * h2. Workflow scripts Work flow scripts consist of both some AVED specific scripts, and EITS specific workflow script. AVED scripts are checked out from the CVS respository Moonjelly and EITS workflow scripts are checked out from the Subversion repository Kahuna. These scripts are used to process the EITS data through AVED. These need to checked out to the Cygwin home directory of the user who is running the workflow (erika ?). # Launch cygwin by double-clicking on the desktop icon\* !cygwin.jpg! # Check-out aved scripts from moonjelly CVS repository. I did this using my dcline account on moonjelly {noformat} export CVS=:pserver:dcline@moonjelly:/home/cvs cvs login cvs co aved/scripts cvs co aved/beoscripts {noformat} # Check-out EITS workflow scripts from subversion.  I did this using my dcline account on Kahuna. {noformat} export SVN_SSH='ssh \-l dcline' svn co svn+ssh://kahuna.shore.mbari.org/svn/repos/eits/trunk/workflow {noformat} * h2. Condor setup As user Administrator, install Condor as Execute-only node according to instructions [Condor setup Windows]. This will by default, allow this node to submit jobs. * h2. Rsyncd setup As user Administrator install the rsyncd daemon. A rsync daemon is used to synchronize the incoming EITs data with a local file system. This rsync process initiates workflow processing and is initiated at a TBD rate by the cron job. # Launch cygwin by double-clicking on the desktop icon !cygwin.jpg! # Create and edit the file /etc/rsyncd.conf and add the following {panel} \# Allows all hosts in the mbari domain or the MARS OPS network access hosts allow = 134.89.0.0/255.255.0.0,10.91.0.0/255.255.0.0 read only = yes \\ \[EITSincoming\] path = /cygdrive/c/EITSincoming comment = Incoming data from the EITS instrument uid = sherman gid = Administrators list = yes {panel} # To install the rsyncd as a service do this: {noformat} cygrunsrv -I "rsyncd" -e CYGWIN=nontsec -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' {noformat}\\ # Now start the rsyncd service: {noformat} net start rsyncd {noformat} * h2. Cron setup As user Administrator install and start the Cron service. The cron service is used to start the rsync process, clean up incoming data and log files. # To install the cron as a service do this: {noformat} cygrunsrv -I cron -p /usr/bin/cron.exe -a -D -u Administrator -e "CYGWIN=ntsec" {noformat} # Next, start the service with: {noformat} cygrunsrv -S cron {noformat} # Now that the service is started, add jobs using the crontab command: {noformat} crontab -e {noformat} {noformat} # At midnight every Sunday remove all files in the incoming directory older than 1 week * 0 * * 0 /usr/bin/find /cygdrive/c/EITSincoming/ \-type f \-ctime \+7 \-exec /bin/rm \-f {} \; # At midnight every Sunday archive raw data in the processed directory older than 1 week to the archive folder * 0 * * 0 /usr/bin/find /cygdrive/c/EITSdata/ \-type f \-ctime \+7 \-exec /bin/mv \-f {} /cygdrive/c/EITSdata/archives \; {noformat}]]> 3113578 5407137 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.    !EITS AVED Processing Activity Milestone1.jpg|thumbnail!\\ h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 5374398 5407135 5374396 5407134 5374395 5407133 5374394 5407131 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.    !EITS AVED Processing Activity Milestone1.jpg|thumbnail!\\ h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 5374392 5407130 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.    !EITS AVED Processing Activity Milestone1.jpg|thumbnail!\\ h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 5374391 5407144 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.    !EITS AVED Processing Activity Milestone1.jpg|thumbnail!\\ h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 5374405 8945678 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.]]> 8912910 5407142 [http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1]. For the EITS milestone1 experiment, it will be e.g.[file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi] * Finish workflow to execute AVED. {color:#0000ff}Using Condor workload management system{color} [http://www.cs.wisc.edu/condor/] * Integrate new segmentation. ** Build on cluster * What should/does transcode system look like? {color:#0000ff}See{color} {color:#0000ff}[EITS Video]{color}{color:#0000ff}.{color} h4. Activity Diagram of the AVED Processing For AVED testing, a short 1 minute AVI clip is generated and processed through the [Condor |Workflow Software] workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.    !EITS AVED Processing Activity Milestone1.jpg|thumbnail!\\ h4. AVED Deployment Diagram This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view. \\ !EITS AVED Deployment Milestone 1.jpg|thumbnail! h3. VARS h4. Load _Events XML_ into VARS !Events XML Handling in EITS.png! h4. How will we reference the source movie file? Some options are: # Setup webserver and reference as URL #* Translate XML movie identifier to URL or other file reference? #* -Movies would be fetched to local cache-. QuickTime handles caching. #* Tried this approach. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov] does not work. Movie at [http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov] works fine. May be due to the size. This implies that the streaming hint may be *very important* to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be *slow* but we can optimize it when we have Movies with streaming hints added. {color:#3300cc}[~dcline]{color} {color:#3300cc}These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that.{color} {color:#3300cc}For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.{color}. {color:#ff0000}I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will{color} {color:#ff0000}{+}not{+}{color} {color:#ff0000}be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. -There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file.- Investigating a method to add hints from Java so that we can integrate it into the _eits-db_ scripting package. #* [~brian] I tested VARS (from Mac OS X, not windows) against [http://mbari649.shore.mbari.org/data/20050923T043059.mov], which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. *A Streaming server is not needed but streaming hints are*) h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] *#* *Initial testing shows that a streaming server is not required*]]> 5374403 8945764 > We'll need to figure out where (Linux or Mac) that we want to do the video conversion. I have 2 scripts that I've used for processing video: 1) hintmovie.groovy. Converts any movie to a streaming-hinted quicktime movie. I'm running it right now on the lvtest.asf...it seems to be working but I'll keep you updated when it's finished (It looks like it's going to take about 30\+ minutes or so;it's running on a pretty ancient machine). 2) addtimecode.groovy. Adds a timecode track. Takes about 2 seconds. -For workflow testing, I'm running hintmovie.groovy on the computer ULUA but this should be moved to a dedicated Mac/Windows computer for the experiment.  What is needed to move this, is to install Condor as an "execute-only" node and modify the Condor job.description and scripts slightly. Not a huge deal. I'm working on posting Condor setup instructions for this in Confluence.- This has been installed as a Condor job on the computer somniosus. See details on Condor installation [here|EITS:Somniosus] for more information.]]> 8913001 806 toConcept -> LinkValue. Currently considered associations are: * "identity-reference | self | " * "saliency | self | " * "start-timecode | self | " h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. More details can be found on [Sourceforge|http://vars.sourceforge.net/Development/datastructure.shtml] !VARS-AnnotationModel.png! ]]> 809 805 toConcept -> LinkValue. Currently considered associations are: * "identity-reference | self | [objectID]" * "saliency | self | [saliency]" * "start-timecode | self | [frameNumber converted to Timecode (HH:MM:SS:FF)]" h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. More details can be found on [Sourceforge|http://vars.sourceforge.net/Development/datastructure.shtml] !VARS-AnnotationModel.png! ]]> 808 804 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. More details can be found on [Sourceforge|http://vars.sourceforge.net/Development/datastructure.shtml] !VARS-AnnotationModel.png! ]]> 807 803 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. More details can be found on [Sourceforge|http://vars.sourceforge.net/Development/datastructure.shtml] !VARS-AnnotationModel.png! ]]> 806 8945786 8913023 8945789 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). Now check the feed be selecting Start encoding photo 8 h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. Open a cygwin window, and  create the service to run this bat file.\\ # Download and install the WME Series SDK somewhere on your computer. # Create a convenient folder to store your files on your hard drive, I recommend "C:\WME" # Open the SDK folder and find the file called *"Wmcmd.vbs"*. If you installed in the default path it will be under *"C:\WMSDK\WMEncSDK9\samples\vb\wmcmd"* Copy this file to your new WME folder. # Create your Session file using the WME graphical interface and save it to your WME folder. # Open Notepad (under Programs \| Accessories) and enter a line such as the following, substituting the correct file names and paths: | cscript.exepath_to_wmcmd.vbs-wmepath_to_session_file | For example: | cscript.exe C:\WME\wmcmd.vbs \-wme C:\wme\stream1.wme | Note: for Win 98 and ME you may get away without the preceeding "cscript.exe" or you can try just "script.exe" # Save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"encode.bat"* with the quotes. # Test the new .BAT file by finding it with My Computer or Explorer and double clicking it. A black DOS box should open and periods (.) should start to appear as encoding progresses. Check to make sure you can access your stream. Now there are two ways to make your .BAT file start automatically without anyone having to logon. The best method is to purchase or find a utility that will allow the .BAT file to run as a service so that no one has to]]> 8913026 8945794 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). Now check the feed be selecting Start encoding photo 8 h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon photo 9; Setup the service by entering the following command in the cygwin shell: {noformat}  cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika  {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. photo]]> 8913031 787 {code}]]> 790 788 {code}]]> 791 789 792 790 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|?| |Focus|?| |Iris|?| |FieldWidth|?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| ]]> 793 791 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| ]]> 794 792 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. Class Diagram !http://vars.sourceforge.net/images/AnnotationClasses.gif! ]]> 795 793 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. Class Diagram !http://vars.sourceforge.net/images/AnnotationClasses.gif! h2. ER Diagram !http://vars.sourceforge.net/images/AnnotationER.gif! ]]> 796 794 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram !http://vars.sourceforge.net/images/AnnotationClasses.gif! h2. VARS ER Diagram !http://vars.sourceforge.net/images/AnnotationER.gif! ]]> 797 294940 OpenURL and enter one of the following:{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov (this one is \~15 minutes){color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. h4. Modify to annotate movie files]]> 163869 795 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram !VARS-AnnotationModel.png! ]]> 798 796 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. !VARS-AnnotationModel.png! ]]> 799 797 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. More details can be found on [Sourceforge|http://vars.sourceforge.net/Development/datastructure.shtml] !VARS-AnnotationModel.png! ]]> 800 799 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. More details can be found on [Sourceforge|http://vars.sourceforge.net/Development/datastructure.shtml] !VARS-AnnotationModel.png! ]]> 802 800 {code}]]> 803 801 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. More details can be found on [Sourceforge|http://vars.sourceforge.net/Development/datastructure.shtml] !VARS-AnnotationModel.png! ]]> 804 802 toConcept -> LinkValue. h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| h2. VARS Class Diagram This is a simplified diagram showing only the fields and classes important to EITS. More details can be found on [Sourceforge|http://vars.sourceforge.net/Development/datastructure.shtml] !VARS-AnnotationModel.png! ]]> 805 294915 OpenURL and enter one of the following:{color} **** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov (this one is \~15 minutes){color} **** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} **** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} *** Translate XML movie identifier to URL or other file reference? h4. Modify to annotate movie files]]> 163844 772 {color:red}...{color} {color:red}...{color} {color:red}...{color} {code}]]> 775 294916 OpenURL and enter one of the following:{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov (this one is \~15 minutes){color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. h4. Modify to annotate movie files]]> 163845 771 774 294917 OpenURL and enter one of the following:{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov (this one is \~15 minutes){color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. h4. Modify to annotate movie files]]> 163846 774 {code}]]> 777 294918 163847 773 {color:red}...{color} {color:red}...{color} {color:red}...{color} {code}]]> 776 294919 OpenURL and enter one of the following:{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov (this one is \~15 minutes){color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. h4. Modify to annotate movie files]]> 163848 776 {code}]]> 779 294920 toConcept -> LinkValue. Currently considered associations are: * "identity-reference | self | " * "saliency | self | " * "start-timecode | self | " h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| ]]> 163849 775 {code}]]> 778 778 781 294922 163851 780 783 294924 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven At MBARI] or download the jars directly from [here|http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] h2. Testing Resources AVED processed data that is used for testing is currently hosted on Nanomia. Here's a few useful links: * EITS test data processed by Ishbel: [http://nanomia.shore.mbari.org/EITS_testing] * Test data with longer clips: [http://nanomia.shore.mbari.org/EITS_testing/RESULTS] * RAID storage for [~brian] mapped to _\\nanomia\RAID\brian_: [http://nanomia.shore.mbari.org/brian] ]]> 163853 779 782 782 785 294926 OpenURL and enter one of the following:{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov (this one is \~15 minutes){color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. h4. Modify to annotate movie files]]> 163855 781 784 294927 OpenURL and enter one of the following:{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov (this one is \~15 minutes){color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} #** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. h4. Modify to annotate movie files]]> 163856 784 787 783 786 785 {code}]]> 788 1025 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven+At+MBARI] or download the jars directly from [here|[http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar] --> Optional. Used by Framecapture code * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar] --> Optional. Used by UI code * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]* (get the latest version) --> Required * [slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar] * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version) ]]> 1028 1024 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code}]]> 1027 1022 1025 1021 1024 8945835 8913074 8945807 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding !WMESetup9.png|align=left! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon !WMESSetup1.png|align=left! Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. !WMESSetup2.png|align=left!]]> 8913044 8945808 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding !WMESetup9.png|align=left! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon !WMESSetup1.png|align=left! Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. !WMESSetup2.png|align=left!]]> 8913045 8945810 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding !WMESetup9.png|align=left! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon !WMESSetup1.png|align=left! Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. !WMESSetup2.png|align=left!]]> 8913047 988 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} [~erikar] The above quote is correct.  Lee will need an API from you to make calls and put data into the VARS system. *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. [~erikar] We still plan to keep all the original data from the mirrored RAID, as you mentioned.  It is my understanding that we will also need to have VARS and AVED loaded onto a computer here in Florida if we want to edit any AVED events; however, the computer in Florida will not require the same cluster arrangement as the AVED processing computer at MBARI.  Is this correct?  Our group will pay for the computer in Florida. {color:#0000cc}Yes, you will not need a cluster. The project has allocated time to setup a workstation for deployment at ORCA which will have what you need to edit the events.  We also have travel money to come to Florida to help setup this computer and for any needed training. I imagine this computer will be a mirrored setup to what we have on the shore-side system here at MBARI (AVED, VARS, etc.), but we still need to work out those details.{color} *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. [~erikar] Lee had a suggestion.  In the beginning we store 3 different video archives 1) all raw EITS data 2) AVED processed data and 3) edited AVED data.  VARS would have three fields, one for each archive.  The pointers in VARS would specify a directory path to the correct archive.  I can explain this better over the phone if you want to call me 772-321-5879. *Q. Where will the EITS computers live?* Initially at MBARI  *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} [~erikar] Lee will provide you with a time-code from EITS *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote}{info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 991 8945803 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon photo 9; Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. photo]]> 8913040 8945805 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon photo 9; Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. photo]]> 8913042 989 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} [~erikar] The above quote is correct.  Lee will need an API from you to make calls and put data into the VARS system. {panel} {panel} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. [~erikar] We still plan to keep all the original data from the mirrored RAID, as you mentioned.  It is my understanding that we will also need to have VARS and AVED loaded onto a computer here in Florida if we want to edit any AVED events; however, the computer in Florida will not require the same cluster arrangement as the AVED processing computer at MBARI.  Is this correct?  Our group will pay for the computer in Florida. {color:#0000cc}Yes, you will not need a cluster. The project has allocated time to setup a workstation for deployment at ORCA which will have what you need to edit the events.  We also have travel money to come to Florida to help setup this computer and for any needed training. I imagine this computer will be a mirrored setup to what we have on the shore-side system here at MBARI (AVED, VARS, etc.), but we still need to work out those details.{color} {panel} {panel} *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. {panel} {panel} *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. [~erikar] Lee had a suggestion.  In the beginning we store 3 different video archives 1) all raw EITS data 2) AVED processed data and 3) edited AVED data.  VARS would have three fields, one for each archive.  The pointers in VARS would specify a directory path to the correct archive.  I can explain this better over the phone if you want to call me 772-321-5879. {panel} {panel} *Q. Where will the EITS computers live?* Initially at MBARI  {panel} {panel} *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} [~erikar] Lee will provide you with a time-code from EITS {panel} {panel} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote}{info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. {panel} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 992 8945800 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon photo 9; Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. photo]]> 8913037 8945802 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon photo 9; Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. photo]]> 8913039 8945796 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). Now check the feed be selecting Start encoding photo 8 h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon photo 9; Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. photo]]> 8913033 8945798 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding photo 8 h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon photo 9; Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. photo]]> 8913035 8945820 Install StorView (Host Based). * cygwin [http://www.cygwin.com/]; ** Select the following additional non-default packages to install: rsync, vi, emacs, bash, cygrunsrv, perl, subversion, openssh, xterm, and cvsutils. * JDK 6 Update 4 from [http://java.sun.com/javase/downloads/index.jsp] h2. Experiment software * [EITS workflow scripts and cron job installation] * [EITS web service] * [EITS RAID directories] * [EITS cron setup] * [EITS rsync setup]]]> 8913057 8945819 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding  !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* # Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. # Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. # Launch a cygwin shell by clicking on the Desktop icon   # Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} # The service should now show up in the services panel as *eitstreaming*, and from there you can start it.  !WMESSetup2.png!]]> 8913056 973 976 8945815 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding  !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon   !WMESSetup1.png! Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it.  !WMESSetup2.png!]]> 8913052 8945817 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding  !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* #Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. #Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. #Launch a cygwin shell by clicking on the Desktop icon   !WMESSetup1.png! #Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} #The service should now show up in the services panel as *eitstreaming*, and from there you can start it.  !WMESSetup2.png!]]> 8913054 8945812 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding !WMESetup9.png|align=left! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon !WMESSetup1.png|align=left! Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. !WMESSetup2.png|align=left!]]> 8913049 8945813 Save As and save the session in your My Documents folder as eits_video_stream. This will save the file as eits_video_stream.wme and this file will then be used in the startup script (see next section). ## Now check the feed be selecting Start encoding  !WMESetup9.png! h2. Windows Media Encoder startup script setup If you have a critical encoder streaming live audio for an Internet radio station or maybe video for a presentation then you want that encoder to be running all the time and you shouldn't have to login and restart the encoder manually if the host computer loses power or reboots. The Windows Media Encoder has a wonderfully simple graphical user interface but unfortunately you cannot directly configure it as a service to run in the background when the host starts up. Fortunately Microsoft provides a command line script that you can use to start an encoding session on boot-up. The following describes how a windows media encoder startup script is configured for the EITS stream. *This assumes you have completed the steps outlined in the Windows Media Encoder setup above first.* Open a Notepad (under Programs \| Accessories) and enter the following line: {noformat} cscript.exe "c:\Program Files\Windows Media Components\Encoder\WMCmd.vbs" \-wme "c:\Documents and Settings\erika\My Documents\eits_video_stream.wme" {noformat} This assumes you stored the Windows Media Encoder session in c:\Documents and Settings\erika\My Documents\eits_video_stream.wme. Save the file to c:\Documents and Settings\erika\My Documents\run_eits_stream.bat. It is important to save the file with the .BAT extension. The easiest way to do this is to put quotation marks around the file name in the Notepad dialog box. For example type *"run_eits_stream{*}*.bat*" with the quotes. Launch a cygwin shell by clicking on the Desktop icon !WMESSetup1.png|align=left! Setup the service by entering the following command in the cygwin shell: {noformat} cygrunsrv -I eitsstreaming -p /cygdrive/c/Documents and Settings/erika/My Documents/run_eits_stream.bat -a -D -u erika {noformat} The service should now show up in the services panel as *eitstreaming*, and from there you can start it. !WMESSetup2.png|align=left!]]> 8913050 9405236 9372505 9405238 9372507 9405237 9372506 9405239 9372508 941 944 942 945 940 943 9405224 9372493 9405225 9372494 933 936 9405230 9372499 937 940 938 941 9405232 9372501 936 939 9405234 9372503 915 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} [~erikar] The above quote is correct.  Lee will need an API from you to make calls and put data into the VARS system. *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. [~erikar] We still plan to keep all the original data from the mirrored RAID, as you mentioned.  It is my understanding that we will also need to have VARS and AVED loaded onto a computer here in Florida if we want to edit any AVED events; however, the computer in Florida will not require the same cluster arrangement as the AVED processing computer at MBARI.  Is this correct?  Our group will pay for the computer in Florida. *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. [~erikar] Lee had a suggestion.  In the beginning we store 3 different video archives 1) all raw EITS data 2) AVED processed data and 3) edited AVED data.  VARS would have three fields, one for each archive.  The pointers in VARS would specify a directory path to the correct archive.  I can explain this better over the phone if you want to call me 772-321-5879. *Q. Where will the EITS computers live?* Initially at MBARI  *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} [~erikar] Lee will provide you with a time-code from EITS *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} {info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 918 912 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote}{color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color}{quote} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* *Q. Where will we store all the data?* *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* *Q. Where will the EITS computers live?* *Q. What are the requirements for supporting _time-code_? Will we use _time-code_ or _run-time_?* {color:#000099}[~dcline] -> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} {info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April.{info} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 915 913 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)*  If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL.  Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. *Q. Where will we store all the data?* Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. *Q. Where will the EITS computers live?* Initially at MBARI  *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} {info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 916 914 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. *Q. Where will the EITS computers live?* Initially at MBARI  *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote} {info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 917 1093 1096 8749058 20 21 2009-01-08 13:50:03.867 2009-01-08 13:50:03.867 1092 1095 1096   These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well.  Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that. For streaming, I think you will need to use the RTSP formatted URL. I'll send more information when I have it.{color} **** Translate XML movie identifier to URL or other file reference? * Modify to annotate movie files]]> 1099 1031 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven+At+MBARI] or download the jars directly from [here|[http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. ]]> 1034 1030 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven+At+MBARI] or download the jars directly from [here|[http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX:http://users.frii.com/jarvi/rxtx/] ]]> 1033 1036 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven+At+MBARI] or download the jars directly from [here|http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] ]]> 1039 1035 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven+At+MBARI] or download the jars directly from [here|[http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] ]]> 1038 1063 1066 12550171 > ~/.profile {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_master {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=$CONDOR_ROOT/etc/condor_config $CONDOR_ROOT/sbin/condor_off -master {noformat} # Use [Lingon|http://lingon.sourceforge.net/] to create a launchd item to execute {{condor_start.sh}} as a service. !org_mbari_eits_Condor_macLingon.png|thumbnail!]]> 12484636 12550166 12484631 1071 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven At MBARI] or download the jars directly from [here|http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] h3. Testing Resources AVED processed data that is used for testing is currently hosted on Nanomia. Here's a few useful links: * EITS test data processed by Ishbel: [http://nanomia.shore.mbari.org/EITS_testing] * Test data with longer clips: [http://nanomia.shore.mbari.org/EITS_testing/RESULTS] * RAID storage for [~brian] mapped to _\\nanomia\RAID\brian_: [http://nanomia.shore.mbari.org/brian] ]]> 1074 12550165 12484630 12550169 > ~/.profile {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=//etc/condor/condor_config $CONDOR_ROOT/sbin/condor_master {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=/etc/condor/condor_config $CONDOR_ROOT/sbin/condor_off -master {noformat} # Use [Lingon|http://lingon.sourceforge.net/] to create a launchd item to execute {{condor_start.sh}} as a service. !org_mbari_eits_Condor_macLingon.png|thumbnail!]]> 12484634 1070 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven At MBARI] or download the jars directly from [here|http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] ]]> 1073 12550167 > ~/.profile {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=/opt/condor-6.8.8/etc/condor_config $CONDOR_ROOT/sbin/condor_master {noformat} # Create {{/opt/condor-7.4.2/sbin/condor_start.sh}} with the following content: {noformat} CONDOR_ROOT=/opt/condor-7.4.2 export PATH=$PATH:$CONDOR_ROOT/sbin:$CONDOR_ROOT/bin export CONDOR_CONFIG=/opt/condor-7.4.2/etc/condor_config $CONDOR_ROOT/sbin/condor_off -master {noformat} # Use [Lingon|http://lingon.sourceforge.net/] to create a launchd item to execute {{condor_start.sh}} as a service. !org_mbari_eits_Condor_macLingon.png|thumbnail!]]> 12484632 1079 1082 1080 1083 1081 1084 1082 1085 1077 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven At MBARI] or download the jars directly from [here|http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] h2. Testing Resources AVED processed data that is used for testing is currently hosted on Nanomia. Here's a few useful links: * EITS test data processed by Ishbel: [http://nanomia.shore.mbari.org/EITS_testing] * Test data with longer clips: [http://nanomia.shore.mbari.org/EITS_testing/RESULTS] * RAID storage for [~brian] mapped to _\\nanomia\RAID\brian_: [http://nanomia.shore.mbari.org/brian] ]]> 1080 1078 1081 1087 1090 1084 1087 1085 1088 1086 1089 10387661 qt4j qt4j [0.10,) compile ... ... VARS VARS Repository http://vars.sourceforge.net/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QTX4J in your [ant build script|CLT:Maven At MBARI] or download the jars directly from [here|http://vars.sourceforge.net/maven2/org/mbari/qtx4j/]. If you do download _QTX4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://vars.sourceforge.net/maven2/imagej/imagej/1.37//imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[MBARIX4J|http://vars.sourceforge.net/maven2/org/mbari/mbarix4j/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr4j|http://vars.sourceforge.net/maven2/org/mbari/vcr4j/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana.shore.mbari.org/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana.shore.mbari.org/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] h2. Testing Resources AVED processed data that is used for testing is currently hosted on Nanomia. Here's a few useful links: * EITS test data processed by Ishbel: [http://nanomia.shore.mbari.org/EITS_testing] * Test data with longer clips: [http://nanomia.shore.mbari.org/EITS_testing/RESULTS] * RAID storage for [~brian] mapped to _\\nanomia\RAID\brian_: [http://nanomia.shore.mbari.org/brian] h2. VARS mini [VARS Mini] ]]> 10354897 20 2007-02-14 14:01:03.380 2015-01-06 11:30:35.870 22 2007-03-07 16:30:09.597 2014-06-30 13:16:57.877 1 2006-10-17 14:48:20.893 2007-03-07 15:56:09.000 12255238 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 12222470 12255242 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 12222474 12255239 0-59/5 * * * * /home/erika/workflow/runEITS /cygdrive/e/EITSprocessed /cygdrive/e/EITSraw > / var/log/runEITS {code}]]> 12222471 15237126 15204358 15237127 15204359 294913   These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well.  Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that. For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.  {color}{color:#3300cc} {color} **** {color:#3300cc}I put some test files in{color} http://nanomia.shore.mbari.org/EITS_testing/STREAMTEST{color:#3300cc}.{color} {color:#3300cc}Files appended with *hintedMP4.mov are the original videos sent to us by Erika, compressed with MP4 and hinted for streaming.  All the other files are the original sources for comparison.{color} **** {color:#3300cc}The streaming server is called seabass. The files can be accessed through RTSP for now. I'll look into how to tunnel them. To view them, open Quicktime, select File->OpenURL and enter one of the following:{color} ***** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov  (this one is \~15 minutes){color} ***** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} ***** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} **** Translate XML movie identifier to URL or other file reference? * Modify to annotate movie files]]> 163842 294914   These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well.  Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that. For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.  {color}{color:#3300cc} {color} *** {color:#3300cc}I put some test files in{color} http://nanomia.shore.mbari.org/EITS_testing/STREAMTEST{color:#3300cc}.{color} {color:#3300cc}Files appended with *hintedMP4.mov are the original videos sent to us by Erika, compressed with MP4 and hinted for streaming.  All the other files are the original sources for comparison.{color} *** {color:#3300cc}The streaming server is called seabass. The files can be accessed through RTSP for now. I'll look into how to tunnel them. To view them, open Quicktime, select File->OpenURL and enter one of the following:{color} **** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov  (this one is \~15 minutes){color} **** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov{color} **** {color:#3300cc}rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov{color} *** Translate XML movie identifier to URL or other file reference? h4. Modify to annotate movie files]]> 163843 622728 589965 10387836 10355099 622727 589964 622729 OpenURL and enter one of the following:{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov] (this one is \~15 minutes){color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov]{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov]{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. #* [~brian] I setup a [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] for testing. This is the same machine that the MySQL database will installed onto. h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies *#* Example URL: [rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov] ]]> 589966 622724 589961 622726 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} [~erikar] The above quote is correct.  Lee will need an API from you to make calls and put data into the VARS system. [~brian] _From Feb 23rd 2007 conference call:_ Lee will deliver Video files ans CSV text anxillary data to the RAID drive on shore. We will write up a loader to stuff the anxillary data into EITS database tables. {panel} {panel} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. [~erikar] We still plan to keep all the original data from the mirrored RAID, as you mentioned.  It is my understanding that we will also need to have VARS and AVED loaded onto a computer here in Florida if we want to edit any AVED events; however, the computer in Florida will not require the same cluster arrangement as the AVED processing computer at MBARI.  Is this correct?  Our group will pay for the computer in Florida. {color:#0000cc}Yes, you will not need a cluster. The project has allocated time to setup a workstation for deployment at ORCA which will have what you need to edit the events.  We also have travel money to come to Florida to help setup this computer and for any needed training. I imagine this computer will be a mirrored setup to what we have on the shore-side system here at MBARI (AVED, VARS, etc.), but we still need to work out those details.{color} {panel} {panel} *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. [~brian] _From Feb 23rd 2007 conference call:_ The current plan is to host a _replicated_ database both at MBARI and ORCA. MySQL 5.0 does support replication but we'll need to test this. [~brian] From [2007-04-11]. Setting up a server for integration testing. _mbari649_ (Mac OS X 10.4) is being setup with MySQL 5, Apache, and Darwin Streaming Server. Also setting up automount of RAID on nanomia. {panel} {panel} *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. [~erikar] Lee had a suggestion.  In the beginning we store 3 different video archives 1) all raw EITS data 2) AVED processed data and 3) edited AVED data.  VARS would have three fields, one for each archive.  The pointers in VARS would specify a directory path to the correct archive.  I can explain this better over the phone if you want to call me 772-321-5879. [~brian] _From Feb 23rd 2007 conference call:_ We will run though a demonstration of the entire data flow before we decide how to manage reprocessing. {panel} {panel} *Q. Where will the EITS computers live?* Initially at MBARI  {panel} {panel} *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} [~erikar] Lee will provide you with a time-code from EITS [~brian] _From Feb 23rd 2007 conference call:_ -Lee is going to investigate using a QuickTime container with MPEG-4 encoding. We'll send him sample code of how to write a TimeCode track.- TimeCode will be written as GMT/UTC time. [~brian] The current plan is for us to add the TimeCode track as part of our workflow. We have a script for doing this. {panel} {panel} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote}{info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. {panel} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 589963 622725 qt4j qt4j [0.5,) compile ... ... MBARI MBARI Repository http://oceana.shore.mbari.org/maven2 ... {code} If you're not using [Maven|http://maven.apache.org/] you can include QT4J in your [ant build script|CLT:Maven At MBARI] or download the jars directly from [here|http://oceana.shore.mbari.org/maven2/qt4j/qt4j]. If you do download _QT4J_ manually, you will also need to install [QuickTime for Java|http://www.apple.com/quicktime/] and fetch these dependencies: * [ImageJ|http://oceana.shore.mbari.org/maven2/imagej/imagej/1.37/imagej-1.37.jar]: Optional. Used for frame-capture * [Foxtrot|http://mirrors.ibiblio.org/pub/mirrors/maven2/foxtrot/foxtrot/2.0/foxtrot-2.0.jar]: Optional. Used by user interface code. * *[mbari-extensions|http://oceana.shore.mbari.org/maven2/mbari-extensions/mbari-extensions/]*: Required (get the latest version) * *[slf4j-api|http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.3.0/slf4j-api-1.3.0.jar]*: Required * [vcr|http://oceana.shore.mbari.org/maven2/vcr/vcr/] (get the latest version): Optional. Used by user interface code. If you include this you will also neet install [RXTX|http://users.frii.com/jarvi/rxtx/] Example code for writing timecode to a movie can be found in [org.mbari.qt.TimeUtil|http://oceana/projects/qt4j/xref/org/mbari/qt/TimeUtil.html#55]. A full example of adding a timecode track, flattening, and saving a file can be found in [org.mbari.qt.TimeCodeTrackLifeCycleTest|http://oceana/projects/qt4j/xref-test/org/mbari/qt/TimeCodeTrackLifeCycleTest.html] h2. Testing Resources AVED processed data that is used for testing is currently hosted on Nanomia. Here's a few useful links: * EITS test data processed by Ishbel: [http://nanomia.shore.mbari.org/EITS_testing] * Test data with longer clips: [http://nanomia.shore.mbari.org/EITS_testing/RESULTS] * RAID storage for [~brian] mapped to _\\nanomia\RAID\brian_: [http://nanomia.shore.mbari.org/brian] ]]> 589962 622701 589936 622705 589942 622706 589943 622703 589938 622693 589927 622697 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} [~erikar] The above quote is correct.  Lee will need an API from you to make calls and put data into the VARS system. [~brian] _From Feb 23rd 2007 conference call:_ Lee will deliver Video files ans CSV text anxillary data to the RAID drive on shore. We will write up a loader to stuff the anxillary data into EITS database tables. {panel} {panel} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. [~erikar] We still plan to keep all the original data from the mirrored RAID, as you mentioned.  It is my understanding that we will also need to have VARS and AVED loaded onto a computer here in Florida if we want to edit any AVED events; however, the computer in Florida will not require the same cluster arrangement as the AVED processing computer at MBARI.  Is this correct?  Our group will pay for the computer in Florida. {color:#0000cc}Yes, you will not need a cluster. The project has allocated time to setup a workstation for deployment at ORCA which will have what you need to edit the events.  We also have travel money to come to Florida to help setup this computer and for any needed training. I imagine this computer will be a mirrored setup to what we have on the shore-side system here at MBARI (AVED, VARS, etc.), but we still need to work out those details.{color} {panel} {panel} *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. [~brian] _From Feb 23rd 2007 conference call:_ The current plan is to host a _replicated_ database both at MBARI and ORCA. MySQL 5.0 does support replication but we'll need to test this. {panel} {panel} *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. [~erikar] Lee had a suggestion.  In the beginning we store 3 different video archives 1) all raw EITS data 2) AVED processed data and 3) edited AVED data.  VARS would have three fields, one for each archive.  The pointers in VARS would specify a directory path to the correct archive.  I can explain this better over the phone if you want to call me 772-321-5879. [~brian] _From Feb 23rd 2007 conference call:_ We will run though a demonstration of the entire data flow before we decide how to manage reprocessing. {panel} {panel} *Q. Where will the EITS computers live?* Initially at MBARI  {panel} {panel} *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} [~erikar] Lee will provide you with a time-code from EITS [~brian] _From Feb 23rd 2007 conference call:_ Lee is going to investigate using a QuickTime container with MPEG-4 encoding. We'll send him sample code of how to write a TimeCode track. TimeCode will be written as GMT/UTC time. {panel} {panel} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote}{info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. {panel} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 589932 622696 589931 622716 OpenURL and enter one of the following:{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov] (this one is \~15 minutes){color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov]{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov]{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. #* [~brian] I setup a [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] for testing. This is the same machine that the MySQL database will installed onto. h4. Modify to annotate movie files h2. Testing server: _mbari649.shore.mbari.org_ * Installed servers *# Apache 2 *#* Directory for served documents - _/Library/WebServer/Documents_. *#* Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The _httpd.conf_ is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account. *# MySQL 5.0 *#* For EITS work the user account to use is _eitsuser_ with password _eits4mbari_ *# [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] *#* Administration console - 127.0.0.1:1220 (I'm the current admin) *#* Directory for served movies - /Library/QuickTimeStreaming/Movies ]]> 589953 622715 I think this is relevant. This is what it says in Lee's "Eye In The Sea - MARS Top-Level System Configuration" under Integration with VARS & AVED:{color} {quote} {color:#000099}As a first thought...functions calls will be made by EITS software to VARS to log appropriate data...data stored into VARS by EITS will consist of a comma-delimted string, transmitted at a frequency of no greater than 1HZ...{color} {quote} [~erikar] The above quote is correct.  Lee will need an API from you to make calls and put data into the VARS system. [~brian] _From Feb 23rd 2007 conference call:_ Lee will deliver Video files ans CSV text anxillary data to the RAID drive on shore. We will write up a loader to stuff the anxillary data into EITS database tables. {panel} {panel} *Q. We intend to start processing video here at MBARI. Will the EITS team buy a computer cluster to use in Florida? (If processing is done at MBARI, we will need to back-up all video before we ship it to Florida.)* [~erikar] If all the initial AVED processing is done at MBARI, we will only need to view the processed video in FL. Therefore, our group will need to purchase a workstation in FL that can run VARS and AVED for post-processing purposes. [~erikar] We still plan to keep all the original data from the mirrored RAID, as you mentioned.  It is my understanding that we will also need to have VARS and AVED loaded onto a computer here in Florida if we want to edit any AVED events; however, the computer in Florida will not require the same cluster arrangement as the AVED processing computer at MBARI.  Is this correct?  Our group will pay for the computer in Florida. {color:#0000cc}Yes, you will not need a cluster. The project has allocated time to setup a workstation for deployment at ORCA which will have what you need to edit the events.  We also have travel money to come to Florida to help setup this computer and for any needed training. I imagine this computer will be a mirrored setup to what we have on the shore-side system here at MBARI (AVED, VARS, etc.), but we still need to work out those details.{color} {panel} {panel} *Q. Where will we store all the data?* [~erikar] Our group would like to have back-ups of all video in FL and can store the data there; however, it might be easier to store the data at MBARI..........we will need to discuss this during our Friday meeting. [~brian] _From Feb 23rd 2007 conference call:_ The current plan is to host a _replicated_ database both at MBARI and ORCA. MySQL 5.0 does support replication but we'll need to test this. [~brian] From [2007-04-11]. Setting up a server for integration testing. _mbari649_ (Mac OS X 10.4) is being setup with MySQL 5, Apache, and Darwin Streaming Server. Also setting up automount of RAID on nanomia. {panel} {panel} *Q. Is reprocessing of video in AVED a requirement? (Warn users that once data is edited in VARS it may not be practical to reprocess the corresponding video in AVED and load it back into VARS.)* [~erikar] Right now I don't see reprocessing video in AVED unless  major changes have been made to the code and earlier data needed to be reprocessed with the modified version. [~erikar] Lee had a suggestion.  In the beginning we store 3 different video archives 1) all raw EITS data 2) AVED processed data and 3) edited AVED data.  VARS would have three fields, one for each archive.  The pointers in VARS would specify a directory path to the correct archive.  I can explain this better over the phone if you want to call me 772-321-5879. [~brian] _From Feb 23rd 2007 conference call:_ We will run though a demonstration of the entire data flow before we decide how to manage reprocessing. {panel} {panel} *Q. Where will the EITS computers live?* Initially at MBARI  {panel} {panel} *Q. What are the requirements for supporting* *{_}time-code{_}{*}*? Will we use* *{_}time-code{_}* *or* *{_}run-time{_}{*}*?* {color:#000099}[~dcline]{color} {color:#000099}\-> T{color}{color:#0000cc}he current plan on this is to use the AVED project cluster during the experiment, and setup a workstation for them to use to reprocess if they want. If the EITS team needs a compute cluster to reprocess video we can certainly help them setup, but it isn't in the proposed budget to buy a cluster. RE: ...{color}{color:#000000}we will need to back-up all video before we ship it to Florida.{color}{color:#0000cc}The current back-up plan is to create an mirrored image of the data. How/when this mirror is created is still TBD, but I imagine a mirrored RAID will be setup to handle this automatically.{color} [~erikar] Lee will provide you with a time-code from EITS [~brian] _From Feb 23rd 2007 conference call:_ -Lee is going to investigate using a QuickTime container with MPEG-4 encoding. We'll send him sample code of how to write a TimeCode track.- TimeCode will be written as GMT/UTC time. [~brian] The current plan is for us to add the TimeCode track as part of our workflow. We have a script for doing this. {panel} {panel} *Q. We originally wanted to schedule a test-tank deployment in June; Craig says MARS the interface won't be ready. (i.e. no point in testing EITS). When will we reschedule?* [~erikar] forwarded the email about this: {quote} Subject: RE: ROV and tank test questions Date: Thu, 25 Jan 2007 16:53:39 \-0800 From: Dawe, Craig To: Erika H. Raymond Hi Erika As to test tank trials. I believe you are referring to a test using the Wet Node Simulator yes? If so, there are a couple of issues, first the simulator has to be built and that is dependent of some hardware from the MARS Electronics package. We do not know when that will arrive however..... The second issue is that the Wet Node Simulator is not scheduled to be completed until the middle of October. Hopefully, both of these issues will go away but that is the schedule for now. Craig {quote}{info}Because of the test-tank delay, EITS delivery to MBARI may be pushed back to early April. {info} We will start our tank tests in Florida during April. {panel} h2. TODO TODO. If you edit results in the AVED editor they're gone forever. We need to make backups of data before it's edited in the editor and warn users.]]> 589952 622710 589947 622709 589946 622708 589945 622707 OpenURL and enter one of the following:{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov] (this one is \~15 minutes){color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov]{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov]{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. #* [~brian] I setup a [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] for testing. This is the same machine that the MySQL database will installed onto. The details are: #** URL - mbari649.shore.mbari.org #** Administration console - 127.0.0.1:1220 (I'm the current admin) #** Current location for served movies - /Library/QuickTimeStreaming/Movies h4. Modify to annotate movie files]]> 589944 622714 toConcept -> LinkValue. Currently considered associations are: * *"identity-reference | self | "* * *"saliency | self | "* * "start-timecode | self | " h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| ]]> 589951 622713 toConcept -> LinkValue. Currently considered associations are: * *"identity-reference | self | "* * *"saliency | self | "* * "start-timecode | self | " h3. CameraData Describes information about camera settings. ||VARS||AVED|| |Name|Name of the camera. Will we be able to swap cameras during the deployment? If so , we will want to keep track of which one is out.| |*Direction*|*This is set in the annotation application*| |Zoom|From anxillary data?| |Focus|From anxillary data?| |Iris|From anxillary data?| |FieldWidth|From anxillary data?| |StillImageURL|URL to a framecapture of the current Frame| h3. PhysicalData This table encapsulates all the physical parameters we will receive from EITS. We may need to modify this class and tables specifically for EITS. ||VARS||AVED|| |Depth|From anxillary data?| |Temperature|From anxillary data?| |Salinity|From anxillary data?| |Oxygen|From anxillary data?| |Light|From anxillary data?| |Latitude|From anxillary data?| |Longitude|From anxillary data?| ]]> 589950 622711 589948 622676 589909 622675 OpenURL and enter one of the following:{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov] (this one is \~15 minutes){color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov]{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov]{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. h4. Modify to annotate movie files]]> 589908 622678 OpenURL and enter one of the following:{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov] (this one is \~15 minutes){color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov]{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov]{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. #* [~brian} I setup a [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] for testing. The details are: #** URL - mbari649.shore.mbari.org #** Administration console - 127.0.0.1:1220 (I'm the current admin) #** Current location for served movies - /Library/QuickTimeStreaming/Movies h4. Modify to annotate movie files]]> 589911 622677 OpenURL and enter one of the following:{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov] (this one is \~15 minutes){color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov]{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov]{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. h4. Modify to annotate movie files]]> 589910 622679 OpenURL and enter one of the following:{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09272006_121528hintedmp4.mov] (this one is \~15 minutes){color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09232005_054508hintedmp4.mov]{color} #** {color:#3300cc}[rtsp://seabass.shore.mbari.org/nanomia/RAID/EITS/STREAMTEST/09222005_153508hintedmp4.mov]{color} #* [~brian] In order to simplify the VARS side of the processing, *movies are required to have a Time-code track*. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. #* [~brian] I setup a [Darwin Streaming Server|http://developer.apple.com/opensource/server/streaming/index.html] for testing. The details are: #** URL - mbari649.shore.mbari.org #** Administration console - 127.0.0.1:1220 (I'm the current admin) #** Current location for served movies - /Library/QuickTimeStreaming/Movies h4. Modify to annotate movie files]]> 589912 6946832 5 false 0.0 0 0 946 5 false 0.0 0 0 22 6 false 0.0 0 0 2163017 6 false 0.0 0 0 938 5 false 0.0 0 0 6258850 5 false 0.0 0 0 3637864 5 false 0.0 0 0 917532 5 false 0.0 0 0 8913021 6 false 0.0 0 0 6946832 6 false 0.0 0 0 6258850 6 false 0.0 0 0 3637963 6 false 0.0 0 0 163852 5 false 0.0 0 0 9798548 5 false 0.0 0 0 3113551 6 false 0.0 0 0 3113240 5 false 0.0 0 0 6258838 6 false 0.0 0 0 6258828 6 false 0.0 0 0 9798548 6 false 0.0 0 0 1179679 6 false 0.0 0 0 6258944 6 false 0.0 0 0 3113242 5 false 0.0 0 0 3113551 5 false 0.0 0 0 3113240 6 false 0.0 0 0 3113242 6 false 0.0 0 0 3637952 6 false 0.0 0 0 22 5 false 0.0 0 0 3637960 6 false 0.0 0 0 163852 6 false 0.0 0 0 3637958 6 false 0.0 0 0 589949 5 false 0.0 0 0 1179679 5 false 0.0 0 0 3637956 6 false 0.0 0 0 6258838 5 false 0.0 0 0 6258828 5 false 0.0 0 0 2163016 5 false 0.0 0 0 3637963 5 false 0.0 0 0 3637960 5 false 0.0 0 0 2163016 6 false 0.0 0 0 3637958 5 false 0.0 0 0 2163017 5 false 0.0 0 0 589928 5 false 0.0 0 0 3637956 5 false 0.0 0 0 3637952 5 false 0.0 0 0 6259292 5 false 0.0 0 0 9372496 6 false 0.0 0 0 917532 6 false 0.0 0 0 9372496 5 false 0.0 0 0 3113176 6 false 0.0 0 0 946 6 false 0.0 0 0 938 6 false 0.0 0 0 698 6 false 0.0 0 0 589928 6 false 0.0 0 0 659 6 false 0.0 0 0 698 5 false 0.0 0 0 3113097 5 false 0.0 0 0 9372210 5 false 0.0 0 0 8913345 5 false 0.0 0 0 589949 6 false 0.0 0 0 3637864 6 false 0.0 0 0 3113110 5 false 0.0 0 0 6259292 6 false 0.0 0 0 3113115 5 false 0.0 0 0 3113115 6 false 0.0 0 0 8913021 5 false 0.0 0 0 1023 6 false 0.0 0 0 8913345 6 false 0.0 0 0 3113134 5 false 0.0 0 0 3113110 6 false 0.0 0 0 3113097 6 false 0.0 0 0 3638049 5 false 0.0 0 0 3113151 5 false 0.0 0 0 3638049 6 false 0.0 0 0 659 5 false 0.0 0 0 3113151 6 false 0.0 0 0 6258944 5 false 0.0 0 0 1023 5 false 0.0 0 0 3113176 5 false 0.0 0 0 9372210 6 false 0.0 0 0 3113134 6 false 0.0 0 0